-- Logs begin at Thu 2022-09-08 15:27:50 UTC, end at Thu 2022-09-08 16:24:25 UTC. -- Sep 08 15:59:15.283776 dv-cinder-856259-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 15:59:15.293269 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 15:59:15 2022] *** Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: nodename: dv-cinder-856259-2-iscsi Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: machine: x86_64 Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: clock source: unix Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: pcre jit disabled Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: detected number of CPU cores: 4 Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: current working directory: / Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: detected binary path: /usr/bin/uwsgi-core Sep 08 15:59:15.295227 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: your processes number limit is 47680 Sep 08 15:59:15.296042 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: your memory page size is 4096 bytes Sep 08 15:59:15.296042 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: detected max file descriptor number: 2048 Sep 08 15:59:15.296042 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: lock engine: pthread robust mutexes Sep 08 15:59:15.296042 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: thunder lock: enabled Sep 08 15:59:15.296042 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 15:59:15.296042 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 15:59:15.334408 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: Python main interpreter initialized at 0x5594ab69c9c0 Sep 08 15:59:15.334408 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: python threads support enabled Sep 08 15:59:15.334408 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: your server socket listen backlog is limited to 100 connections Sep 08 15:59:15.334408 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: your mercy for graceful operations on workers is 90 seconds Sep 08 15:59:15.334777 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 15:59:15.334777 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: *** Operational MODE: preforking *** Sep 08 15:59:15.336324 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: *** uWSGI is running in multiple interpreter mode *** Sep 08 15:59:15.336324 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: spawned uWSGI master process (pid: 105745) Sep 08 15:59:15.336324 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: spawned uWSGI worker 1 (pid: 105757, cores: 1) Sep 08 15:59:15.336324 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: spawned uWSGI worker 2 (pid: 105758, cores: 1) Sep 08 15:59:15.336324 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 15:59:15.335225 dv-cinder-856259-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 15:59:15.986660 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 15:59:15.991199 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 15:59:17.044757 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:59:17.044757 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: from cryptography.utils import int_from_bytes Sep 08 15:59:17.045549 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:59:17.045549 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: from cryptography.utils import int_from_bytes Sep 08 15:59:17.046634 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:59:17.046634 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: from cryptography.utils import int_from_bytes Sep 08 15:59:17.047122 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 15:59:17.047122 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: from cryptography.utils import int_from_bytes Sep 08 15:59:19.497357 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 15:59:19.497911 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 15:59:19.498022 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 15:59:19.498401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 15:59:19.498654 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 15:59:19.499034 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.499356 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.499708 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.500021 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.500347 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.500650 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.500965 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.501280 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.501604 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.501843 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.502149 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.502490 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-2-iscsi {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.502787 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.503087 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.503390 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.503732 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.504023 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.504338 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.504637 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.505127 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.505586 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.505879 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.506187 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.506446 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 15:59:19.506826 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.506918 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 15:59:19.507011 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.507091 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.507223 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 15:59:19.507403 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.507618 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 15:59:19.507708 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.507878 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 15:59:19.508022 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.508253 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.508351 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.508588 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.508693 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-2-iscsi {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.508910 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509017 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509235 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509377 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509580 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509695 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509884 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.509990 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.510201 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.510317 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.510525 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.510626 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.510852 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.510953 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.511137 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.511250 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.511427 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.511552 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.511778 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-2-iscsi {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.511923 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512074 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512203 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512387 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512484 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512697 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512795 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.512992 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.513076 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.513295 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.513380 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.513600 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.513771 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514000 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514090 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514298 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514476 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514587 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514792 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.514878 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.515102 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.515187 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.515421 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.515564 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.515760 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.515845 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516079 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516175 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516327 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516414 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516573 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516698 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.516887 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.517012 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.517203 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.517337 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.517507 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.517653 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.517812 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518048 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-2-iscsi {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518146 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518368 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518461 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518683 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518792 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.518983 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.519070 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.519288 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.519401 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.519614 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.519737 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.519926 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.520049 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.520240 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.520374 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.520559 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.520699 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.520865 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521010 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521183 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521344 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521579 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521669 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521838 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.521975 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.522126 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.522297 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.522449 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.522601 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.522766 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.522912 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.523070 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.523223 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.523387 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.523571 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.523727 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.523879 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524032 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524185 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524333 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524422 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524637 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524723 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.524954 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525046 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525282 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525367 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525582 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525680 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525830 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.525915 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.526126 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.526217 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.526425 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.526523 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.526740 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.526826 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527043 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527129 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527345 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527470 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527671 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527757 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.527973 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528059 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528275 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528361 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528577 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528663 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528881 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.528967 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.529184 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.529276 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.529483 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.529570 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.529806 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.529891 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.530107 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.530193 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.530409 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.530493 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.530748 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.530848 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.531049 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.531162 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.531363 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.531535 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.531704 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.531798 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532007 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532092 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532309 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532422 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532611 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532704 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.532914 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533006 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533231 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533316 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533534 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533630 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533837 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.533923 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.534156 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.534458 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.534554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.534756 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.534849 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.535066 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.535159 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.535370 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.535494 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.535696 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.535787 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536009 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536099 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536305 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536404 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536607 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536701 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.536921 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537016 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537225 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537328 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537524 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537622 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537823 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.537913 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.538126 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.538223 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.538425 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.538514 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.538725 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.538815 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539024 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539194 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539324 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539426 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539640 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539743 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.539945 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540038 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540256 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540341 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540557 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540640 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540860 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.540946 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.541161 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.541252 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.541475 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.541558 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.541784 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.541869 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.542095 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.542187 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.542404 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.542499 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.542714 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.542800 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.543039 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.543125 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.543351 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.543435 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.543687 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.543781 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.543998 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.544083 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.544331 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.544427 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.544635 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.544729 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.544943 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.545027 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.545307 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.545404 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.545618 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.545702 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.545934 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.546019 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.546240 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.546332 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.546554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.546638 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.546862 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.546946 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.547171 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.547502 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.547627 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.547738 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.547842 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.547950 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.548097 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.548215 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.548407 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.548519 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.548719 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.549045 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.549330 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.549634 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.549726 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.549958 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.550050 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.550287 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.550390 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.550599 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.550685 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.550912 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.550997 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.551221 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.551323 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.551568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 15:59:19.551704 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.551911 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552000 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552216 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552317 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552528 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552626 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552872 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.552999 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.553186 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.553280 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.553498 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.553583 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.553816 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.553908 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.554125 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.554254 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.554448 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.554532 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.554757 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.554841 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.555067 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.555154 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.555376 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.555483 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.555712 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.555798 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556023 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556112 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556347 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556442 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556657 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556741 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.556977 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.557063 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.557289 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.557374 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.557598 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.557689 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.557912 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558007 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558219 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558304 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558526 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558611 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558838 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.558931 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.559144 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.559264 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.559473 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.559590 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.559771 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.559879 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.560078 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.560164 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.560380 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.560483 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.560700 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.560787 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561053 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561138 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561357 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561524 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561684 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561777 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.561991 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.562079 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.562299 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.562393 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.562610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.562718 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.562917 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563037 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563219 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563310 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563559 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563651 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563870 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.563959 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.564171 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.564261 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.564484 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.564573 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.564790 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.564879 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.565095 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.565186 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.565419 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.565508 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.565724 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.565821 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566030 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566119 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566344 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566433 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566658 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566755 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.566967 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.567056 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.567281 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.567379 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.567616 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.567719 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.567927 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568023 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568237 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568327 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568543 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568646 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568846 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.568934 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.569159 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.569257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.569469 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.569568 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.569792 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.569891 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.570115 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.570204 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.570421 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.570510 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.570721 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.570817 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.571031 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.571129 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.571334 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.571423 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.571661 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.571751 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572005 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572162 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572262 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572346 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572590 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572739 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572862 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.572959 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.573166 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.573257 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.573467 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.573557 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.573769 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.573867 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574082 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574170 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574387 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574475 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574690 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574788 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.574992 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.575082 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.575328 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.575553 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.575648 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.575747 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.575971 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.576105 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.576292 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.576454 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.576661 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.576807 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.576987 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.577118 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.577292 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.577434 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.577609 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.577739 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.577911 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578043 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578220 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578351 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578528 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578672 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578826 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.578919 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.579128 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.579219 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.579824 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.579935 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.580137 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.580236 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.580441 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.580531 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.580741 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.580836 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581043 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581132 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581352 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581450 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581661 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581749 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.581956 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582045 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582259 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582364 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582657 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582875 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.582989 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.583172 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.583286 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.583536 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.583646 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.583842 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.583930 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.584151 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.584257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.584451 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.584550 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.584739 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.584824 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585043 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585137 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585353 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585438 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585668 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585762 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.585976 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.586078 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.586291 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.586383 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.586597 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.586683 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.586916 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587040 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587223 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587308 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587559 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587660 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587862 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.587949 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.588171 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.588256 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.588497 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.588598 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.588821 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.588908 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.589124 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.589208 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.589434 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.589528 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.589744 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.589829 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590048 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590155 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590355 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590524 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590666 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590760 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.590969 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.591054 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.591268 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.591361 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.591600 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.591687 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.591914 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592010 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592268 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592364 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592577 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592663 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592880 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.592965 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.593193 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.593370 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.593501 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.593587 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.593805 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.593898 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.594105 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.594192 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.594413 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.594505 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.594731 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.594817 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.595043 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.595128 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.595359 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.595468 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.595699 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.595783 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596002 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596098 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596305 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596390 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596624 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596708 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.596929 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597014 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597229 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597313 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597529 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597622 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597831 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.597916 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.598173 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.598268 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.598479 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.598577 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.598785 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.598870 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.599099 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.599184 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.599413 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.599574 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.599742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.599834 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600051 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600136 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600353 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600455 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600659 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600745 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.600976 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601068 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601284 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601369 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601590 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601674 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601893 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.601977 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.602199 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.602286 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.602511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.602601 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.602815 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.602933 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.603120 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.603205 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.603426 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.603583 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.603754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.603840 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.604061 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.604147 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.604362 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.604448 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.604668 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.604761 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605218 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605313 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605313 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605553 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605639 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605881 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.605968 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.606193 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.606276 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.606505 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.606596 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.606815 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.606901 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.607140 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.607232 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.607478 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.607566 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.607830 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.607925 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.608144 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.608229 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.608449 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.608540 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.608761 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.608859 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609065 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609149 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609365 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609674 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609769 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.609975 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610061 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610281 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610375 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610584 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610670 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610892 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.610976 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.611194 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.611279 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.611518 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.611616 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.611823 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.611915 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.612126 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.612212 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.612439 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.612525 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.612738 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.612823 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613047 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613131 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613347 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613448 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613659 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.613958 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.614051 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.614257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.614531 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.614616 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.614849 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.614933 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.615173 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.615258 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.615502 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.615592 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.615842 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.615928 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.616171 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.616271 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.616502 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.616586 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.616803 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.616887 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.617108 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.617202 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.617429 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.617513 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.617729 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.617814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618034 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618131 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618336 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618419 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618646 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618737 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.618950 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619036 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619246 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619329 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619575 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619708 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619883 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.619970 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.620186 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.620281 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.620487 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.620579 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.620788 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.620875 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.621093 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.621178 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.621391 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.621475 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.621702 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.621787 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622004 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622088 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622305 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622398 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622605 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622697 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622911 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.622996 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.623214 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.623335 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.623585 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.623728 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.623895 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.623992 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.624192 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.624285 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.624506 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.624591 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.624807 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.624893 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.625107 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.625205 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.625407 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.625515 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.625713 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.625830 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626020 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626144 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626320 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626476 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626640 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626788 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.626971 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.627098 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.627249 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.627409 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.627574 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.627752 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.627881 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.628066 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.628182 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.628373 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.628482 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.628693 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.628791 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629006 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629110 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629321 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629407 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629635 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629721 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.629942 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630029 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630254 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630338 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630555 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630687 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630856 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.630943 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.631162 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.631256 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.631480 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.631568 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.631785 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.631869 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.632085 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.632185 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.632387 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.632473 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.632688 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.632772 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633004 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633101 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633307 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633397 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633608 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633694 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.633910 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634008 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634211 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634297 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634515 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634599 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634831 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.634925 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.635146 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.635232 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.635464 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.635552 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.635793 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.635890 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.636110 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.636195 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.636414 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.636498 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.636720 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.636805 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637029 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637113 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637327 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637411 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637631 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637723 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.637935 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638019 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638248 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638339 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638555 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638641 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638856 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.638940 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.639198 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.639287 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.639532 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.639620 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.639843 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.639928 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.640161 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.640255 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.640480 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.640565 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.640782 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.640866 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.641091 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.641183 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.641395 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.641479 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.641702 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.641785 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642005 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642098 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642309 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642393 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642617 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642702 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.642927 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643088 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643232 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643356 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643563 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643663 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643875 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.643962 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.644183 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.644276 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.644487 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.644573 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.644797 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.644883 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.645104 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.645196 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.645405 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.645490 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.645726 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.645811 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646032 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646116 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646335 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646420 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646643 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646729 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.646943 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647035 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647249 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647342 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647576 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647678 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.647999 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.648200 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.648294 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.648532 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.648625 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.648850 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.648936 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.649167 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.649259 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.649478 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.649563 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.649796 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.649889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.650101 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.650197 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.650402 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.650488 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.650712 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.650815 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.651031 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.651124 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.651346 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.651431 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.651689 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.651807 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652003 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652091 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652302 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652386 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652612 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652697 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.652924 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653009 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653222 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653305 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653524 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653608 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653824 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.653917 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.654134 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.654220 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.654430 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.654546 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.654795 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.654889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.655208 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.655293 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.655540 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.655758 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.655846 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.656205 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.656289 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.656528 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.656666 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.656835 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.657120 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.657205 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.657454 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.657590 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.657776 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.658067 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.658153 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.658374 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.658675 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.658760 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.658991 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.659118 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.659310 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.659625 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.659724 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.659946 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.660248 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.660333 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.660569 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.660779 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.660891 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.661116 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.661209 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.661449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.661534 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.661776 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.661896 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.662094 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.662216 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.662525 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.662610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.662839 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.662935 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.663155 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.663239 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.663498 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.663647 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.663774 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.663901 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.664083 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.664208 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.664386 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.664480 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.664690 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.664775 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665012 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665095 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665311 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665396 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665619 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665704 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.665923 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666013 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666229 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666316 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666532 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666616 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666831 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.666969 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.667150 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.667286 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.667468 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.667624 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.667790 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668047 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668144 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668367 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668452 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668684 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668776 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.668999 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.669090 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.669320 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.669406 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.669629 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.669721 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.669932 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670024 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670275 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670372 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670579 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670671 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670906 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.670991 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.671213 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.671296 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.671565 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.671667 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.671885 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.671984 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.672199 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.672292 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.672506 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.672600 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.672838 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.672924 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.673153 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.673237 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.673467 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.673565 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.673775 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.673891 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.674091 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.674221 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.674415 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.674540 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.674721 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.674869 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675020 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675200 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675326 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675540 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675657 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675860 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.675944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.676181 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.676276 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.676494 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.676578 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.676806 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.676890 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.677101 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.677192 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.677400 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.677494 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.677719 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.677805 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678019 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678113 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678332 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678416 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678639 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678731 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.678934 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679027 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679236 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679321 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679567 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679655 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679898 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.679998 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.680195 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.680279 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.680519 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.680603 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.680826 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.680918 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.681134 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.681255 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.681443 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.681539 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.681755 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.681842 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682061 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682144 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682368 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682460 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682670 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682762 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.682976 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.683060 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.683287 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.683417 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.683616 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.683704 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.683930 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.684064 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.684242 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.684333 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.684554 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.684639 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.684912 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.685073 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.685244 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.685397 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.685570 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.685708 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.685958 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.686123 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.686283 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.686434 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.686615 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.686925 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687009 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687235 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687330 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687576 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687666 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687886 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.687970 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.688194 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.688289 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.688501 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.688586 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.688811 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.688895 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.689120 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.689217 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.689430 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.689515 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.689739 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.689834 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.690071 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.690157 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.690382 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.690467 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.690691 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.690782 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691004 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691092 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691310 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691462 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691650 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691751 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.691959 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692054 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692270 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692355 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692583 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692677 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692897 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.692983 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.693216 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.693301 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.693528 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.693624 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.693842 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.693963 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.694152 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.694239 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.694460 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.694596 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.694768 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.694862 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.695089 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.695283 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.695479 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.695626 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.695744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.695859 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696034 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696124 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696349 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696517 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696661 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696902 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.696987 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.697231 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.697327 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.697808 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.697893 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.698122 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.698208 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.698446 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.698534 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.698771 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.698857 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.699090 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.699174 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.699404 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.699540 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.699749 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.699835 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700064 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700148 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700367 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700452 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700669 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700768 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.700976 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.701062 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.701282 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.701406 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.701612 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.701700 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.701934 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702029 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702241 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702326 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702543 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702628 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702857 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.702952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.703164 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.703251 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.703539 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.703719 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.703906 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.704075 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.704231 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.704395 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.704906 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.705087 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.705227 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.705414 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.705552 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.705732 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.705881 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706046 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706209 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706375 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706521 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706681 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706845 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.706988 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.707164 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.707303 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.707504 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.707637 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.707824 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.707943 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.708146 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.708233 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.708467 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.708552 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.708800 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.708895 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.709132 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.709224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.709440 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.709535 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.709741 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.709836 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710061 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710145 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710365 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710450 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710672 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710895 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.710988 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.711216 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.711302 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.711587 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.711692 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.711893 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.711981 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.712196 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.712281 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.712502 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.712607 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.712813 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.712898 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.713113 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.713206 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.713422 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.713518 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.713726 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.713812 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714036 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714166 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714347 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714433 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714655 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714743 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.714963 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.715054 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.715283 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.715411 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.715609 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.715695 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.715920 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.716015 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.716229 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.716315 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.716536 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.716765 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.716851 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.717182 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.717288 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.717503 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.717600 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.717836 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.717922 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.718169 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.718256 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.718492 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.718717 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.718804 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.719054 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.719148 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.719374 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.719486 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.719733 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.719821 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720056 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720150 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720367 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720452 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720672 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720765 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.720972 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721070 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721285 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721369 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721591 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721676 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721896 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.721981 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.722201 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.722293 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.722504 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.722588 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.722811 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.722897 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.723118 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.723204 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.723424 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.723541 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.723752 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.723839 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724061 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724146 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724367 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724459 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724670 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724755 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.724976 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725098 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725280 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725374 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725590 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725679 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725903 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.725989 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.726218 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.726314 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.726536 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.726621 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.726852 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.726938 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.727163 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.727257 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.727498 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.727589 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.727810 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.727895 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.728117 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.728206 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.728423 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.728510 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.728729 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.728813 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729038 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729124 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729349 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729434 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729663 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729747 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.729966 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.730053 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.730278 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.730631 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.730722 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.730953 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.731052 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.731270 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.731527 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.731614 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.731873 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.731975 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.732202 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.732288 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.732518 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.732604 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.732871 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.732968 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.733186 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.733269 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.733490 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.733583 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.733797 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.733891 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.734128 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.734218 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.734446 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.734531 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.734761 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.734849 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735059 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735143 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735361 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735539 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735685 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735773 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.735994 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.736079 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.736309 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.736401 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.736618 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.736703 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.736917 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737008 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737218 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737313 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737525 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737617 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737824 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.737909 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.738126 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.738220 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.738428 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.738513 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.738736 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.738822 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739043 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739343 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739428 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739668 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739755 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.739970 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740071 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740269 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740354 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740570 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740655 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740872 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.740958 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.741178 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.741263 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.741478 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.741570 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.741781 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.741868 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.742082 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.742167 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.742383 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.742468 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.742685 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.742771 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.743014 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.743356 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.743463 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.743696 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.743783 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744018 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744107 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744332 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744417 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744653 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744743 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.744960 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745046 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745281 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745366 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745594 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745719 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745904 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.745991 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.746210 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.746302 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.746542 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.746628 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.746850 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.746935 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.747161 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.747256 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.747547 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.747643 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.747804 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.747903 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.748111 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.748212 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.748470 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.748564 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.748787 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.748873 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.749113 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.749208 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.749414 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.749499 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.749728 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.749815 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750037 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750125 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750349 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750434 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750656 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750747 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.750961 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.751047 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.751267 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.751361 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.751605 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.751692 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.751914 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752000 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752219 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752305 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752524 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752617 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752827 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.752912 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.753134 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.753220 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.753437 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.753530 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.753742 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.753834 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754052 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754137 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754355 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754449 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754664 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754750 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.754974 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.755059 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.755281 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.755372 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.755613 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.755702 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.755935 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756030 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756277 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756364 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756588 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756681 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756914 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.756998 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.757230 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.757318 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.757537 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.757622 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.757849 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.757934 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.758151 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.758275 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.758392 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 15:59:19.758479 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.758783 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.759096 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.759432 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.759769 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.760085 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.760403 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.760719 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.761032 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.761345 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.761677 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.762008 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.762316 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.762648 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.762969 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.763292 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.763637 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.763982 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.764314 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.764630 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.764947 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.765260 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.765573 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.765892 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.766218 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.766532 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.766848 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.767168 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.767582 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.767918 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.768250 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.768566 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.768894 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.769225 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.769575 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.769892 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.770241 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.770574 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.770890 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.771207 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.771540 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 15:59:19.771786 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105758) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 15:59:19.914114 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO dbcounter [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Registered counter for database nova_api Sep 08 15:59:19.927651 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO dbcounter [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Registered counter for database nova_api Sep 08 15:59:19.935727 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_db.sqlalchemy.engines [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:19.942746 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writer thread running {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:19.947595 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_db.sqlalchemy.engines [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:19.955192 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writer thread running {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:19.999730 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.context [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8767b60e-3134-411b-81c6-9212f447c551(cell1) {{(pid=105757) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 15:59:20.003711 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 15:59:20.004187 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 15:59:20.005759 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 15:59:20.006475 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 15:59:20.006913 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 15:59:20.008904 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 15:59:20.010892 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO dbcounter [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Registered counter for database nova_cell0 Sep 08 15:59:20.012508 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.context [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8767b60e-3134-411b-81c6-9212f447c551(cell1) {{(pid=105758) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 15:59:20.015119 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO dbcounter [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Registered counter for database nova_cell1 Sep 08 15:59:20.016767 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_concurrency.lockutils [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 15:59:20.017252 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_concurrency.lockutils [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 15:59:20.021711 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_concurrency.lockutils [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 15:59:20.021711 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_concurrency.lockutils [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 15:59:20.021711 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_concurrency.lockutils [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 15:59:20.022395 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_concurrency.lockutils [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105758) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 15:59:20.022565 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_db.sqlalchemy.engines [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:20.024162 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_db.sqlalchemy.engines [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:20.024580 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO dbcounter [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Registered counter for database nova_cell0 Sep 08 15:59:20.028701 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO dbcounter [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Registered counter for database nova_cell1 Sep 08 15:59:20.029270 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writer thread running {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:20.036013 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_db.sqlalchemy.engines [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:20.038259 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_db.sqlalchemy.engines [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:20.043328 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writer thread running {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:20.046100 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writer thread running {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:20.163783 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writer thread running {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:20.174062 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO dbcounter [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Registered counter for database nova_cell0 Sep 08 15:59:20.184050 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_db.sqlalchemy.engines [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:20.188629 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writer thread running {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:20.189595 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO dbcounter [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Registered counter for database nova_cell0 Sep 08 15:59:20.198253 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG oslo_db.sqlalchemy.engines [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105758) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 15:59:20.203302 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writer thread running {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 15:59:20.528603 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: WARNING keystonemiddleware.auth_token [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 15:59:20.535776 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: WARNING keystonemiddleware.auth_token [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 15:59:20.536182 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: WARNING keystonemiddleware.auth_token [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 15:59:20.543160 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: WARNING keystonemiddleware.auth_token [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 15:59:20.886625 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: WARNING keystonemiddleware.auth_token [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 15:59:20.892696 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: WARNING keystonemiddleware.auth_token [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 15:59:20.894591 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: WARNING keystonemiddleware.auth_token [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 15:59:20.898527 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594ab69c9c0 pid: 105757 (default app) Sep 08 15:59:20.900674 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 15:59:20.900810 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: WARNING keystonemiddleware.auth_token [None req-359f3f80-0de4-45e9-a55e-2e42025cfe96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 15:59:20.901856 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Sep 08 15:59:20.902277 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Thu Sep 8 15:59:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 15:59:20.906858 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5594ab69c9c0 pid: 105758 (default app) Sep 08 16:00:42.255023 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:42.256079 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 08 16:00:42.256439 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:00:42.268867 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_api:SELECT=3 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.270236 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_cell0:SELECT=3 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.271369 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_cell1:SELECT=3 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:42.272216 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:43.151275 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-697fd086-6c18-42be-8b41-d76bb4713ac8 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:43.186680 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-697fd086-6c18-42be-8b41-d76bb4713ac8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923096 Sep 08 16:00:43.187473 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 16:00:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:00:45.769678 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:45.770763 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-8662923c-ff24-4c04-a71a-8287eb56cd23 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 08 16:00:45.771341 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:00:46.249316 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-fa1a4c35-d2ca-474f-9d9b-2183a1db0d9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:46.296884 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-fa1a4c35-d2ca-474f-9d9b-2183a1db0d9c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519670 Sep 08 16:00:46.297446 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:00:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:46.311699 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_api:SELECT=3 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.312518 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_cell0:SELECT=3 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.315148 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_cell1:SELECT=3 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.317236 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:00:46.519369 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-506ca7b0-3b9f-43db-a6db-600a69a0afdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:46.590061 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-506ca7b0-3b9f-43db-a6db-600a69a0afdd admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283348 Sep 08 16:00:46.590855 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 16:00:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:00:49.148648 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-fa1a4c35-d2ca-474f-9d9b-2183a1db0d9c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:49.149944 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-fa1a4c35-d2ca-474f-9d9b-2183a1db0d9c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Sep 08 16:00:49.150841 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:00:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:00:49.806125 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-8e453425-4662-4408-aa0d-d966f9d95d36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:49.848062 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-8e453425-4662-4408-aa0d-d966f9d95d36 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.690502 Sep 08 16:00:49.848965 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:00:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:49.861380 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-2a55455f-2031-47d6-9f70-50c689ab5bcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:49.899672 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-2a55455f-2031-47d6-9f70-50c689ab5bcf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042047 Sep 08 16:00:49.900244 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 16:00:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:00:52.439302 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-8e453425-4662-4408-aa0d-d966f9d95d36 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:52.440351 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-8e453425-4662-4408-aa0d-d966f9d95d36 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 08 16:00:52.440715 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:00:52.873884 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-7a27291d-04d9-4e84-b17e-d5731787d2e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:52.894641 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-7a27291d-04d9-4e84-b17e-d5731787d2e9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447339 Sep 08 16:00:52.895323 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:00:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:52.907665 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-3ab4f058-ecaa-4660-b3fb-8f78b4b62d8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:52.938213 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-3ab4f058-ecaa-4660-b3fb-8f78b4b62d8a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034324 Sep 08 16:00:52.939185 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 16:00:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:00:55.544026 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-7a27291d-04d9-4e84-b17e-d5731787d2e9 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:55.545047 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-7a27291d-04d9-4e84-b17e-d5731787d2e9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 08 16:00:55.545450 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:00:55.977222 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-c7e39690-71e6-4db2-b5fd-d61bcc8b76b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:55.997389 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-c7e39690-71e6-4db2-b5fd-d61bcc8b76b6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445745 Sep 08 16:00:55.999497 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:00:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:56.010482 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-7d629c9e-9b71-42bd-8ad9-3b86fa8f46a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:56.037857 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-7d629c9e-9b71-42bd-8ad9-3b86fa8f46a3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031089 Sep 08 16:00:56.038444 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 16:00:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:00:58.623573 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-c7e39690-71e6-4db2-b5fd-d61bcc8b76b6 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:00:58.624689 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-c7e39690-71e6-4db2-b5fd-d61bcc8b76b6 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 08 16:00:58.625075 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:00:59.078167 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-7465aa95-7b46-4ca0-af89-05d30d570a2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:59.103477 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-7465aa95-7b46-4ca0-af89-05d30d570a2c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472111 Sep 08 16:00:59.104474 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:00:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:00:59.119391 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-76b6c574-7765-4c49-8880-3aa51bcbc5eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:00:59.148008 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-76b6c574-7765-4c49-8880-3aa51bcbc5eb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032306 Sep 08 16:00:59.148878 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Thu Sep 8 16:00:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:01:01.738191 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-7465aa95-7b46-4ca0-af89-05d30d570a2c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:01.739160 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-7465aa95-7b46-4ca0-af89-05d30d570a2c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Sep 08 16:01:01.739559 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:02.221217 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-af5de24f-ad94-42b0-b774-26c3089fa1e7 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:02.247377 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-af5de24f-ad94-42b0-b774-26c3089fa1e7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.499661 Sep 08 16:01:02.247983 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 16:01:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:05.034953 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-7465aa95-7b46-4ca0-af89-05d30d570a2c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:05.036105 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-7465aa95-7b46-4ca0-af89-05d30d570a2c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Sep 08 16:01:05.036524 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:05.439127 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-5a3bbbe1-5ab4-43f0-ba97-533ee62550a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "vcpus": 1}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:05.459794 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-5a3bbbe1-5ab4-43f0-ba97-533ee62550a7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.417317 Sep 08 16:01:05.460373 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:01:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:05.473152 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-eecfcbee-f833-4aa8-8e57-4b7df32b3636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:05.502678 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-eecfcbee-f833-4aa8-8e57-4b7df32b3636 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033597 Sep 08 16:01:05.503295 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 16:01:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:01:08.126265 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-5a3bbbe1-5ab4-43f0-ba97-533ee62550a7 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:08.127262 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-5a3bbbe1-5ab4-43f0-ba97-533ee62550a7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 08 16:01:08.127711 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:08.526458 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-b523526f-4912-411c-8537-183d4bb22ac8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:08.546171 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-b523526f-4912-411c-8537-183d4bb22ac8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412139 Sep 08 16:01:08.547043 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:01:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:01:08.558917 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-dd973a2f-1882-4d33-bd86-61c575f11b40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:08.583091 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-dd973a2f-1882-4d33-bd86-61c575f11b40 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027908 Sep 08 16:01:08.584139 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 16:01:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:01:11.187405 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-b523526f-4912-411c-8537-183d4bb22ac8 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:11.188487 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-b523526f-4912-411c-8537-183d4bb22ac8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 08 16:01:11.188861 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:11.617282 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-0016ee0e-b279-4197-8b2c-7bf682225d1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:11.641739 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-0016ee0e-b279-4197-8b2c-7bf682225d1d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.446296 Sep 08 16:01:11.642311 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:01:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:11.654906 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-0a818337-a812-4d4d-9b7c-d3a8bbe2be6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:11.684882 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-0a818337-a812-4d4d-9b7c-d3a8bbe2be6b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033817 Sep 08 16:01:11.686195 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 16:01:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:01:14.235200 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-0016ee0e-b279-4197-8b2c-7bf682225d1d admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:14.236317 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-0016ee0e-b279-4197-8b2c-7bf682225d1d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Sep 08 16:01:14.236954 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:14.782376 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-b77148aa-dac5-4ce2-bf8c-65ce3b47d18f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:14.788149 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:14.806014 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-b77148aa-dac5-4ce2-bf8c-65ce3b47d18f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.562674 Sep 08 16:01:14.806575 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:01:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:01:14.819068 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-a2b3cd12-6f31-4aa5-8f6d-9e8bcb424dc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:14.845314 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-a2b3cd12-6f31-4aa5-8f6d-9e8bcb424dc1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029916 Sep 08 16:01:14.846057 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 16:01:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:01:17.513496 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-b77148aa-dac5-4ce2-bf8c-65ce3b47d18f admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:17.514461 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-b77148aa-dac5-4ce2-bf8c-65ce3b47d18f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 08 16:01:17.515006 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:17.957695 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-eaee7982-6d1d-4015-8813-1b28f01105ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "disk": 160, "vcpus": 8}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:17.964372 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:17.982025 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-eaee7982-6d1d-4015-8813-1b28f01105ce admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460560 Sep 08 16:01:17.982681 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Thu Sep 8 16:01:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:17.994686 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-3842775f-a872-4335-a84d-039662554ba1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:18.023487 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-3842775f-a872-4335-a84d-039662554ba1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032330 Sep 08 16:01:18.024931 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Thu Sep 8 16:01:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:01:34.568657 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-eaee7982-6d1d-4015-8813-1b28f01105ce admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:34.570279 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-eaee7982-6d1d-4015-8813-1b28f01105ce admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002332 Sep 08 16:01:34.570940 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:34.585504 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:01:35.013430 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-571fd048-ef01-4d5b-a6b8-41c58233fbe8 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:35.032011 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-571fd048-ef01-4d5b-a6b8-41c58233fbe8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.454158 Sep 08 16:01:35.032521 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 16:01:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:36.345126 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-eaee7982-6d1d-4015-8813-1b28f01105ce admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:36.346132 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-eaee7982-6d1d-4015-8813-1b28f01105ce admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 08 16:01:36.346519 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:36.897169 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-a04b839a-c5a2-41a1-a0ce-c0eb98a0f9b4 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:36.904889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.wsgi [None req-a04b839a-c5a2-41a1-a0ce-c0eb98a0f9b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-a04b839a-c5a2-41a1-a0ce-c0eb98a0f9b4 admin admin] Request method failure captured: Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Accept: application/json Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Accept-Encoding: gzip, deflate Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Connection: keep-alive Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Content-Length: 0 Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Host: 10.222.0.27 Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Openstack-Api-Version: compute 2.92 Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Openstack-System-Scope: None Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: User-Agent: python-novaclient Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Auth-Token: gAAAAABjGhHgWraeI43xGNtpCFjihFfthZCWw6sjE8l83p2zK9nomkqUH3IJz2Tle2ekn2shczT0TByWnzeViJhUPIfzJpKy7Tq6Mc5SQiTIIAQW4SrhkY1Xx4WA_SYInOo51Ar7OyUriRJe5abM6JqhmHiErAphhQHMsHMRIwTd0mOeoic6ZAg Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Domain-Id: None Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Domain-Name: None Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Identity-Status: Confirmed Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Is-Admin-Project: True Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Domain-Id: default Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Domain-Name: Default Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Name: admin Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Role: admin,reader,member Sep 08 16:01:36.908136 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Roles: admin,reader,member Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e21b84c9f53a40aa98d4a318db545714", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}] Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant: admin Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant-Name: admin Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User: admin Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Domain-Id: default Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Domain-Name: Default Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Id: 02fc092547d04cbf984e632c0755920a Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Name: admin Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: method: > Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: exception: Flavor 42 could not be found. Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: action_args: {'id': '42'} Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:01:36.909889 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:36.910960 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.912511 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-a04b839a-c5a2-41a1-a0ce-c0eb98a0f9b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:01:36.913809 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-a04b839a-c5a2-41a1-a0ce-c0eb98a0f9b4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.426542 Sep 08 16:01:36.913809 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 16:01:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:01:36.920487 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-c066f346-48b1-4e4d-a246-40ce27bd16ea admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:36.943298 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-c066f346-48b1-4e4d-a246-40ce27bd16ea admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026469 Sep 08 16:01:36.943812 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 16:01:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:01:36.954783 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-801e0831-16fd-4cdf-8a71-796850f90ef7 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:36.976512 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-801e0831-16fd-4cdf-8a71-796850f90ef7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026584 Sep 08 16:01:36.977039 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 16:01:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:36.986545 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-894d15c2-e9e1-48ae-9c72-6aa11fcfa6e9 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:36.992410 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.wsgi [None req-894d15c2-e9e1-48ae-9c72-6aa11fcfa6e9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-894d15c2-e9e1-48ae-9c72-6aa11fcfa6e9 admin admin] Request method failure captured: Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Accept: application/json Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Accept-Encoding: gzip, deflate Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Connection: keep-alive Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Content-Length: 0 Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Host: 10.222.0.27 Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Openstack-Api-Version: compute 2.92 Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Openstack-System-Scope: None Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: User-Agent: python-novaclient Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Auth-Token: gAAAAABjGhHgWraeI43xGNtpCFjihFfthZCWw6sjE8l83p2zK9nomkqUH3IJz2Tle2ekn2shczT0TByWnzeViJhUPIfzJpKy7Tq6Mc5SQiTIIAQW4SrhkY1Xx4WA_SYInOo51Ar7OyUriRJe5abM6JqhmHiErAphhQHMsHMRIwTd0mOeoic6ZAg Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Domain-Id: None Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Domain-Name: None Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Identity-Status: Confirmed Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Is-Admin-Project: True Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Domain-Id: default Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Domain-Name: Default Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Name: admin Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Role: admin,reader,member Sep 08 16:01:36.995744 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Roles: admin,reader,member Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e21b84c9f53a40aa98d4a318db545714", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}] Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant: admin Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant-Name: admin Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User: admin Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Domain-Id: default Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Domain-Name: Default Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Id: 02fc092547d04cbf984e632c0755920a Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Name: admin Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: method: > Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: exception: Flavor 42 could not be found. Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: action_args: {'id': '42'} Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:01:36.997257 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:36.998610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:36.999944 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-894d15c2-e9e1-48ae-9c72-6aa11fcfa6e9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:01:37.001184 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-894d15c2-e9e1-48ae-9c72-6aa11fcfa6e9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014222 Sep 08 16:01:37.001184 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 16:01:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:01:38.224886 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-801e0831-16fd-4cdf-8a71-796850f90ef7 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:38.225935 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-801e0831-16fd-4cdf-8a71-796850f90ef7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 08 16:01:38.226331 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:38.785942 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-5b010dc5-011a-4ed5-bc94-7f641296d54d admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:38.791209 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.wsgi [None req-5b010dc5-011a-4ed5-bc94-7f641296d54d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-5b010dc5-011a-4ed5-bc94-7f641296d54d admin admin] Request method failure captured: Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Accept: application/json Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Accept-Encoding: gzip, deflate Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Connection: keep-alive Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Content-Length: 0 Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Host: 10.222.0.27 Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Openstack-Api-Version: compute 2.92 Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Openstack-System-Scope: None Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: User-Agent: python-novaclient Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Auth-Token: gAAAAABjGhHiL8NQ-gn4spWJPM4GUgv3RGDR46cUOwAWJB1dZOp3HrDVPoEt3t1PhYwl4EXqCYCZUfYyQHceAtdO8uxsJLPmvcpFxqfhI0cnW3sPb_aBFRtK99QlgNij-gPSQM4VgvtB2sBCHfFa5sn46sGAvVYMOJbz5VjpNk4JwB9Ybw0jNDA Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Domain-Id: None Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Domain-Name: None Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Identity-Status: Confirmed Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Is-Admin-Project: True Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Domain-Id: default Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Domain-Name: Default Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Name: admin Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Role: admin,reader,member Sep 08 16:01:38.792754 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Roles: admin,reader,member Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e21b84c9f53a40aa98d4a318db545714", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}] Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant: admin Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant-Name: admin Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User: admin Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Domain-Id: default Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Domain-Name: Default Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Id: 02fc092547d04cbf984e632c0755920a Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Name: admin Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: method: > Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: exception: Flavor 84 could not be found. Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: action_args: {'id': '84'} Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:01:38.794212 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:38.795244 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.796742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-5b010dc5-011a-4ed5-bc94-7f641296d54d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:01:38.798207 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-5b010dc5-011a-4ed5-bc94-7f641296d54d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.431429 Sep 08 16:01:38.798207 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 16:01:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:01:38.804196 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-d1d075c9-9417-4d77-b23d-21fd2eabe223 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:38.819274 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-d1d075c9-9417-4d77-b23d-21fd2eabe223 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018689 Sep 08 16:01:38.819865 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 16:01:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:38.829712 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b1f1b252-559a-45fe-b6b2-dd33ca154955 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:38.845454 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-b1f1b252-559a-45fe-b6b2-dd33ca154955 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019858 Sep 08 16:01:38.845989 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 16:01:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:38.854980 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-c1bb408c-0941-424e-b388-b3cf5fde4810 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:38.860066 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.wsgi [None req-c1bb408c-0941-424e-b388-b3cf5fde4810 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-c1bb408c-0941-424e-b388-b3cf5fde4810 admin admin] Request method failure captured: Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Accept: application/json Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Accept-Encoding: gzip, deflate Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Connection: keep-alive Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Content-Length: 0 Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Host: 10.222.0.27 Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Openstack-Api-Version: compute 2.92 Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Openstack-System-Scope: None Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: User-Agent: python-novaclient Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Auth-Token: gAAAAABjGhHiL8NQ-gn4spWJPM4GUgv3RGDR46cUOwAWJB1dZOp3HrDVPoEt3t1PhYwl4EXqCYCZUfYyQHceAtdO8uxsJLPmvcpFxqfhI0cnW3sPb_aBFRtK99QlgNij-gPSQM4VgvtB2sBCHfFa5sn46sGAvVYMOJbz5VjpNk4JwB9Ybw0jNDA Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Domain-Id: None Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Domain-Name: None Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Identity-Status: Confirmed Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Is-Admin-Project: True Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Domain-Id: default Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Domain-Name: Default Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Name: admin Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Role: admin,reader,member Sep 08 16:01:38.861554 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Roles: admin,reader,member Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e21b84c9f53a40aa98d4a318db545714", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}] Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant: admin Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant-Name: admin Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User: admin Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Domain-Id: default Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Domain-Name: Default Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Id: 02fc092547d04cbf984e632c0755920a Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Name: admin Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: method: > Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: exception: Flavor 84 could not be found. Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: action_args: {'id': '84'} Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:01:38.862964 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:38.863814 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:38.865224 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-c1bb408c-0941-424e-b388-b3cf5fde4810 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:01:38.866229 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-c1bb408c-0941-424e-b388-b3cf5fde4810 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011390 Sep 08 16:01:38.866229 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Sep 8 16:01:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:01:40.094772 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b1f1b252-559a-45fe-b6b2-dd33ca154955 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:40.095847 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-b1f1b252-559a-45fe-b6b2-dd33ca154955 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 08 16:01:40.096237 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:40.644297 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-cb61805e-0ebf-48e3-a73b-a8373f2be804 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:40.650399 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.wsgi [None req-cb61805e-0ebf-48e3-a73b-a8373f2be804 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-cb61805e-0ebf-48e3-a73b-a8373f2be804 admin admin] Request method failure captured: Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Accept: application/json Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Accept-Encoding: gzip, deflate Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Connection: keep-alive Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Content-Length: 0 Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Host: 10.222.0.27 Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Openstack-Api-Version: compute 2.92 Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Openstack-System-Scope: None Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: User-Agent: python-novaclient Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Auth-Token: gAAAAABjGhHjwdAS5ECmbS53UHjrt1RPyvgUXqZmmjPymOC3Es2WQ_W8z064k0FrTlAwGf9GS3NmQNHzYh9592mbzN9yk_kWZ2qolA_-pM5HrjH3uh8FRbDF5V2BPd3LJQBn_MKxtm1ichXSpgm1bkVfL1a-3BIA0-mcKU2YzUePBZcWHCrXMEs Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Domain-Id: None Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Domain-Name: None Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Identity-Status: Confirmed Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Is-Admin-Project: True Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Domain-Id: default Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Domain-Name: Default Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Project-Name: admin Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Role: admin,reader,member Sep 08 16:01:40.651952 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Roles: admin,reader,member Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e21b84c9f53a40aa98d4a318db545714", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}] Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant: admin Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-Tenant-Name: admin Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User: admin Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Domain-Id: default Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Domain-Name: Default Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Id: 02fc092547d04cbf984e632c0755920a Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: X-User-Name: admin Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: method: > Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: exception: Flavor 451 could not be found. Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: action_args: {'id': '451'} Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:01:40.653462 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:40.654449 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.655568 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-cb61805e-0ebf-48e3-a73b-a8373f2be804 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105758) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:01:40.656609 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-cb61805e-0ebf-48e3-a73b-a8373f2be804 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.420350 Sep 08 16:01:40.656609 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 16:01:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:01:40.663635 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b45e7a45-93ad-4e56-ba34-f7c7883a6769 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:40.681026 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-b45e7a45-93ad-4e56-ba34-f7c7883a6769 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021139 Sep 08 16:01:40.681557 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 16:01:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:40.691145 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:40.706505 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018898 Sep 08 16:01:40.707045 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Sep 8 16:01:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:01:40.716398 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b86d0748-4846-4262-ac0d-50a67eea7d3a admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:40.722294 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.wsgi [None req-b86d0748-4846-4262-ac0d-50a67eea7d3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b86d0748-4846-4262-ac0d-50a67eea7d3a admin admin] Request method failure captured: Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Accept: application/json Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Accept-Encoding: gzip, deflate Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Connection: keep-alive Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Content-Length: 0 Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Host: 10.222.0.27 Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Openstack-Api-Version: compute 2.92 Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Openstack-System-Scope: None Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: User-Agent: python-novaclient Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Auth-Token: gAAAAABjGhHjwdAS5ECmbS53UHjrt1RPyvgUXqZmmjPymOC3Es2WQ_W8z064k0FrTlAwGf9GS3NmQNHzYh9592mbzN9yk_kWZ2qolA_-pM5HrjH3uh8FRbDF5V2BPd3LJQBn_MKxtm1ichXSpgm1bkVfL1a-3BIA0-mcKU2YzUePBZcWHCrXMEs Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Domain-Id: None Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Domain-Name: None Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Identity-Status: Confirmed Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Is-Admin-Project: True Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Domain-Id: default Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Domain-Name: Default Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Project-Name: admin Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Role: admin,reader,member Sep 08 16:01:40.723821 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Roles: admin,reader,member Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e21b84c9f53a40aa98d4a318db545714", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e21b84c9f53a40aa98d4a318db545714"}]}] Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant: admin Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant-Id: e21b84c9f53a40aa98d4a318db545714 Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-Tenant-Name: admin Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User: admin Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Domain-Id: default Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Domain-Name: Default Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Id: 02fc092547d04cbf984e632c0755920a Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: X-User-Name: admin Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: method: > Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: exception: Flavor 451 could not be found. Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: action_args: {'id': '451'} Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:01:40.725321 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:40.726263 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: ERROR nova.api.openstack.wsgi Sep 08 16:01:40.727401 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b86d0748-4846-4262-ac0d-50a67eea7d3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105757) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:01:40.728825 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-b86d0748-4846-4262-ac0d-50a67eea7d3a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012434 Sep 08 16:01:40.728825 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 16:01:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 16:01:41.981184 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:41.982205 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 08 16:01:41.982700 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:42.568590 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-6c4f8375-e6a2-40c5-9625-038652751fbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:42.592361 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-6c4f8375-e6a2-40c5-9625-038652751fbc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.467191 Sep 08 16:01:42.592967 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 16:01:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:43.821003 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:43.822047 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 08 16:01:43.822442 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:44.382421 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-974e10f8-d43b-45a3-8af9-2896b59e4f5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:44.404169 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-974e10f8-d43b-45a3-8af9-2896b59e4f5f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.445493 Sep 08 16:01:44.404752 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 16:01:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:45.644626 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:45.645653 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 08 16:01:45.646075 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:46.238130 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-3546e8f7-adad-4d57-a417-3f61607b9b53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:46.264533 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-3546e8f7-adad-4d57-a417-3f61607b9b53 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.476989 Sep 08 16:01:46.265074 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 16:01:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:47.486600 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:47.487698 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 08 16:01:47.488104 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:48.032016 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-429bff76-e07a-42a3-97cd-13bb44c54ef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:01:48.060267 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-429bff76-e07a-42a3-97cd-13bb44c54ef5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.436425 Sep 08 16:01:48.061018 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Sep 8 16:01:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:01:49.425828 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:49.426846 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 08 16:01:49.427241 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:01:50.004715 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-b8335290-697e-4573-81e2-d0c88a2ef19b admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:01:50.025901 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-b8335290-697e-4573-81e2-d0c88a2ef19b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.464548 Sep 08 16:01:50.026442 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Sep 8 16:01:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:02:46.720147 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:02:46.721217 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-8224769a-4b0d-472a-b68d-085048bee220 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Sep 08 16:02:46.721636 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Thu Sep 8 16:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:02:46.732610 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:47.141216 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-8842c883-a071-487c-bdfe-a4f7cd7bce7c admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:02:47.162656 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-8842c883-a071-487c-bdfe-a4f7cd7bce7c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.434367 Sep 08 16:02:47.163234 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Thu Sep 8 16:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:02:47.186028 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_api:SELECT=14 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:02:47.190087 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-f8963bc1-73f6-40e2-bf84-cd57ae9dbe79 admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:02:47.200023 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-f8963bc1-73f6-40e2-bf84-cd57ae9dbe79 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015483 Sep 08 16:02:47.200599 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Thu Sep 8 16:02:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:02:47.212970 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-f1d71188-4aa3-4fcd-a3c5-03368e6da743 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:02:47.220727 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-f1d71188-4aa3-4fcd-a3c5-03368e6da743 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011490 Sep 08 16:02:47.221248 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Thu Sep 8 16:02:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:02:47.232807 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:02:47.240131 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010819 Sep 08 16:02:47.240578 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Thu Sep 8 16:02:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:02:47.251815 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-57f04233-c971-4acb-8ecd-2c44aef2dc99 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:02:47.258950 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-57f04233-c971-4acb-8ecd-2c44aef2dc99 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010672 Sep 08 16:02:47.259481 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Thu Sep 8 16:02:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:05:52.679917 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:05:52.680933 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 08 16:05:52.681295 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:05:52.820255 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_api:SELECT=6 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:05:52.995709 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:05:53.000638 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:05:53.001109 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:05:53.001534 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:05:53.002235 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:05:53.002677 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:05:53.003094 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:05:53.034445 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-f05b6733-6e99-4eb0-b085-6f50313af7e3 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.215346 Sep 08 16:05:53.034983 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 16:05:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:05:54.115319 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:05:54.116509 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 08 16:05:54.116742 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:05:54.317236 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:05:54.320742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:05:54.321137 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:05:54.321565 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:05:54.322271 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:05:54.322763 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:05:54.323178 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:05:54.342797 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-6bfac05d-5c87-4e2a-8be9-cbce013dd2c6 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.085887 Sep 08 16:05:54.343333 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 16:05:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:06:05.846171 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:06:05.847184 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 08 16:06:05.847599 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:06:05.994077 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_cell0:SELECT=4 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:06:05.994798 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_cell1:SELECT=4 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:06:05.995402 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG dbcounter [-] [105757] Writing DB stats nova_api:SELECT=8 {{(pid=105757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:06:06.051423 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:06:06.055046 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:06:06.055698 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:06:06.056255 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:06:06.057224 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:06:06.057768 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:06:06.058313 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:06:06.084197 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-cec143ec-a08a-434c-b3a9-1faee15bee6b admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.095438 Sep 08 16:06:06.084742 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 16:06:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:06:07.164542 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG nova.api.openstack.wsgi [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] Calling method '>' {{(pid=105758) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:06:07.165552 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: INFO nova.api.openstack.requestlog [None req-110fb2f8-6400-4091-a0bf-59e7b8fb7f6c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 08 16:06:07.165963 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: [pid: 105758|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Sep 8 16:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:06:07.360177 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG nova.api.openstack.wsgi [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Calling method '>' {{(pid=105757) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:06:07.363624 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:06:07.364035 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:06:07.364460 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:06:07.365173 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:06:07.365628 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:06:07.366036 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: DEBUG oslo_concurrency.lockutils [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105757) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:06:07.387774 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: INFO nova.api.openstack.requestlog [None req-79807f87-856c-4bbb-9359-cbe372c9ce31 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084896 Sep 08 16:06:07.388400 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: [pid: 105757|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Sep 8 16:06:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:07:03.679968 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: Thu Sep 8 16:07:03 2022 - graceful shutdown triggered... Sep 08 16:07:03.680499 dv-cinder-856259-2-iscsi devstack@n-api.service[105757]: Gracefully killing worker 1 (pid: 105757)... Sep 08 16:07:03.681051 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: Gracefully killing worker 2 (pid: 105758)... Sep 08 16:07:03.682304 dv-cinder-856259-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 16:07:03.812904 dv-cinder-856259-2-iscsi devstack@n-api.service[105758]: DEBUG dbcounter [-] [105758] Writing DB stats nova_api:SELECT=4 {{(pid=105758) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:04.680404 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: worker 1 buried after 1 seconds Sep 08 16:07:04.680404 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: worker 2 buried after 1 seconds Sep 08 16:07:04.680404 dv-cinder-856259-2-iscsi devstack@n-api.service[105745]: goodbye to uWSGI. Sep 08 16:07:04.682956 dv-cinder-856259-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 16:07:04.683896 dv-cinder-856259-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 16:07:04.688417 dv-cinder-856259-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 16:07:04.707689 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 16:07:04 2022] *** Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: nodename: dv-cinder-856259-2-iscsi Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: machine: x86_64 Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: clock source: unix Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: pcre jit disabled Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: detected number of CPU cores: 4 Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: current working directory: / Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: detected binary path: /usr/bin/uwsgi-core Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: your processes number limit is 47680 Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: your memory page size is 4096 bytes Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: detected max file descriptor number: 2048 Sep 08 16:07:04.710531 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: lock engine: pthread robust mutexes Sep 08 16:07:04.711710 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: thunder lock: enabled Sep 08 16:07:04.711710 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 16:07:04.711710 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 16:07:04.750937 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: Python main interpreter initialized at 0x55cfd663d9c0 Sep 08 16:07:04.750937 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: python threads support enabled Sep 08 16:07:04.750937 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: your server socket listen backlog is limited to 100 connections Sep 08 16:07:04.750937 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: your mercy for graceful operations on workers is 90 seconds Sep 08 16:07:04.751312 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 16:07:04.751312 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: *** Operational MODE: preforking *** Sep 08 16:07:04.751586 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: *** uWSGI is running in multiple interpreter mode *** Sep 08 16:07:04.751586 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: spawned uWSGI master process (pid: 120763) Sep 08 16:07:04.764947 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: spawned uWSGI worker 1 (pid: 120782, cores: 1) Sep 08 16:07:04.764947 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: spawned uWSGI worker 2 (pid: 120783, cores: 1) Sep 08 16:07:04.764947 dv-cinder-856259-2-iscsi devstack@n-api.service[120763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 16:07:04.751787 dv-cinder-856259-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 16:07:05.404865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 16:07:05.405530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 16:07:06.543671 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:07:06.543671 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: from cryptography.utils import int_from_bytes Sep 08 16:07:06.544289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:07:06.544289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: from cryptography.utils import int_from_bytes Sep 08 16:07:06.544449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:07:06.544449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: from cryptography.utils import int_from_bytes Sep 08 16:07:06.544449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 16:07:06.544449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: from cryptography.utils import int_from_bytes Sep 08 16:07:08.948431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 16:07:08.949121 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 16:07:08.949494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 16:07:08.950289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 16:07:08.950289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 16:07:08.950289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.950580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.950862 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.951185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.951563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.951889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.952212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.952565 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.952896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.953124 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.953478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.953988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-2-iscsi {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.954317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.954629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.954942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.955244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.955580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.955940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.956250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.956760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.958136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.958136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.958136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.958533 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.958765 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.959075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.959437 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.959745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.960098 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.960384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.960843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-2-iscsi {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.961131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.961481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.961739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.962270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.962562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.962902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.963198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.963568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.963942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.964256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.964553 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.964876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.965195 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.965500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.965812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.966109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.966445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.966747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.967054 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.967306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.967639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.967962 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.968285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.968609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.968861 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.969133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.969423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.969762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.970064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.970377 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.970677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.970981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.971288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.971604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.971911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.972217 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.972536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.972858 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.973175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.973483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.973812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.974229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.974477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.974784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.975131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.975570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.975789 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.976112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.976531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.976742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.977050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.977358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.977722 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.978062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.978369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.978623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.978930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.979234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.979588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.979902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.980204 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.980514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.980816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.981124 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.981433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.981738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.982045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.982352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.982658 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.983005 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.983295 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.983592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.983955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.984220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.984541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.984846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.985381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.985546 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.985750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.986063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.986369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.986707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.986993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.987308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.987630 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.987951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.988260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.988567 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.988889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.989191 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.989498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.989817 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.990127 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.990429 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.990732 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.991039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.991343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.991672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.991978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.992283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.992582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.992849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 16:07:08.993672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.993925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 16:07:08.994326 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.994512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 16:07:08.994720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.994720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.995081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 16:07:08.995081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 16:07:08.995438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.995438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.995781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.995926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.996075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.996226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.996382 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.996382 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.996684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.996684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.997084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.997084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.997373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.997536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.997696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.997847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.998022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.998022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.998446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.998446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.998807 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.998997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.999182 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.999182 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.999569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856259-2-iscsi {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:08.999768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:08.999964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.000152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.000448 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.000640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.000829 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.001016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.001209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.001390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.001547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.001698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.001856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.002009 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.002160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.002318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.002470 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.002649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.002795 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.002967 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.003217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.003366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.003560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.003860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.004018 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.004197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.004532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.004756 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.004913 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.005072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.005216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.005405 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.005551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.005717 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.005870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.006065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.006214 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.006364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.006515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856259-2-iscsi {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.006659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.006811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.006954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.007102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.007268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.007523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.007698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.007698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.008004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.008148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.008298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.008442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.008594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.008739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.008883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.009040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.009184 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.009334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.009486 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.009630 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.009783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.009934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.010094 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.010243 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.010403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.010664 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.010824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.010969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.011112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.011264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.011418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.011596 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.011768 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.011921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.012071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.012224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.012369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.012511 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.012652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.012801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.012952 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.013108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.013252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.013394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.013552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.013706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.014009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.014171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.014454 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.014684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.014834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.014979 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.015132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.015288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.015432 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.015637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.015840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.016017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.016180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.016326 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.016477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.016627 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.016778 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.016936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.016936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.017230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.017381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.017550 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.017788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.017788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.018104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.018293 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.018445 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.018588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.018588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.018879 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.019029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.019029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.019342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.019517 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.019675 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.019829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.019829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.020127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.020270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.020413 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.020569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.020569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.020952 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.021103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.021103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.021386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.021623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.021778 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.021928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.021928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.022217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.022369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.022523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.022676 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.022676 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.022947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.023096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.023239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.023399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.023399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.023738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.023917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.023917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.024356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.024981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.025163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.025319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.025319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.025592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.025744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.025888 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.026045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.026045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.026323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.026485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.026485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.026770 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.026923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.027074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.027224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.027373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.027539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.027539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.027935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.028087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.028230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.028372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.028372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.028678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.028823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.028971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.029123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.029123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.029402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.029554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.029705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.029856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.029856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.030135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.030329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.030496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.030648 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.030648 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.031040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.031197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.031354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.031570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.031570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.031849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.031993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.032143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.032297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.032297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.032587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.032731 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.032884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.033037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.033037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.033328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.033476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.033622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.033764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.033764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.034048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.034353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.034636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.034801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.034801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.035179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.035338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.035499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.035663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.035663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.035943 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.036096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.036242 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.036392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.036545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.036710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.036710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.036981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.037131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.037283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.037435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.037435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.037720 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.037871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.038157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.038329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.038485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.038637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.038793 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.038936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.039076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.039231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.039384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.039598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.039878 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.040027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.040208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.040475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.040626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.040837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.041110 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.041282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.041451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.041609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.041753 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.042054 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.042211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.042356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.042663 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.042831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.042976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.043207 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.043357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.043606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.043908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.044094 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.044463 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.045556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.045786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.045960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.046118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.046118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.046390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.046534 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.046534 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.046807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.046971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.046971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.047245 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.047395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.047395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.047740 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.047903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.048064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.048064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.048494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.048494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.048785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.048940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.049104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.049250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.049393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.049393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.049688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.049851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 16:07:09.050000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.050000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.050287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.050439 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.050677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.050833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.050988 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.051145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.051477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.051644 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.051809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.051966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.052119 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.052272 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.052416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.052576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.052729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.052880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053776 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.053925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.054084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.054239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.054414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.054836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.054998 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.055150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.055293 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.055512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.055955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.056109 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.056253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.056396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.056596 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.056753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.056909 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057205 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057499 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057499 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.057936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.058086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.058231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.058398 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.058686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.058686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.058997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.059150 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.059303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.059474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.059624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.059790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.059790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060070 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.060964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.061108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.061251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.061401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.061677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.061839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.061992 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.062152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.062299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.062450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.062593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.062745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.062897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.063047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.063198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.063356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.063534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.063721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.063891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.064043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.064207 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.064352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.064496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.064662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.064990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.065141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.065292 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.065436 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.065588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.065757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.066973 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.067124 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.067275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.067426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.067660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.067813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.067959 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.068112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.068256 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.068411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.068572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.068828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.068980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.069131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.069282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.069433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.069587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.069741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.069892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070035 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070645 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.070949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.071100 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.071257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.071470 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.071623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.071876 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.072027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.072170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.072341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.072487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.072637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.072787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.073274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.073425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.073583 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.073728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.073880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.074031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.074185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.074335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.074491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.074661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.074813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.075176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.075328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.075531 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.075682 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.075834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.075997 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.076329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.076482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.076643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.076794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.076938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077245 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077699 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.077995 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.078154 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.078305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.078457 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.078607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.078758 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079207 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079531 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.079964 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.080117 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.080348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.080495 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.080703 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.080861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.081020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.081190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.081355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.081518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.081709 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.081889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.082151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.082308 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.082471 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.082629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.082824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.082980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.083138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.083312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.083511 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.083669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.083869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084036 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084192 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084357 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.084965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.085333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.085501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.085653 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.085821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.085980 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.086156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.086511 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.086672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.086831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.087010 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.087208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.087367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.087581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.087743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.087893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.088969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.089250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.089420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.089586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.089586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.089872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.090787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.091094 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.091265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.091265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.091586 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.091740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.091897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.092056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.092056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.092506 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.092659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.092659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.092960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.093118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.093277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.093427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.093427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.093718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.093876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094195 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094195 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094647 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094647 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.094944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.095096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.095096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.095789 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.095989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.096176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.096551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.096551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.096932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.097131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.097318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.097503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.097503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.097877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.098135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.098135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.098508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.098693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.098890 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.099086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.099086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.099613 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.099782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.099947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.100107 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.100107 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.100412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.100563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.100563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.100864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.101946 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.102097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.102097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.102489 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.102700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.102700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.103009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.103168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.103168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.103610 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.103782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.103952 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.104913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.105205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.105356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.105356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.105864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.106018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.106179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.106329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.106329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.106783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.106960 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.107121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.107273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.107273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.107597 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.107801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.107955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.108104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.108104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.108104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.108552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.108717 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.108875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.109025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.109182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.109332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.109481 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.109657 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.109898 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110682 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.110990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.111139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.111289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.111461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.111657 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.111811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.111969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.112120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.112269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.112444 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.112716 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.112873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113774 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.113774 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.114074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.114296 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.114563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.114850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.115154 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.115328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.115513 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.115945 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.116108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.116267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.116466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.116633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.116946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.117120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.117273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.117273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.117589 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.117740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.117898 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.118058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.118244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.118435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.118598 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.118750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.118906 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.119067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.119217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.119402 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.119588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.119751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.119930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.120175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.120340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.120491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.120640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.120796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.120960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.121119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.121270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.121426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.121584 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.121746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.121908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.122059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.122216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.122378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.122537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.122714 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.122970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.123135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.123294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.123471 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.123628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.123868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124038 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124195 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.124947 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.125146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.125309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.125461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.125611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.125787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.126131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.126285 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.126444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.126609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.126760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.127081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.127244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.127403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.127618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.127779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.127930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.128080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.128247 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.128411 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.128570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.128721 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.128870 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.129953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.130103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.130397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.130568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.130726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.130877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131026 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.131974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.132123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.132290 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.132441 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.132601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.132752 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.132910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.133173 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.133345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.133506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.133673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.133854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134517 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134681 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134832 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.134989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.135153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.135304 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.135518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.135675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.135836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.136166 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.136340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.136493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.136493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.136787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.136948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.137257 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.137429 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.137591 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.137749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.137909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.137909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.138248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.138403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.138561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.138561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.138854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139005 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.139980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.140282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.140543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.140702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.140860 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141195 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141513 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.141982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.142134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.142476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.144170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.144577 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.144784 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.144989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.145179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.145389 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.145585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.145771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.145963 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.146360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.146551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.146736 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.146924 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.147110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.147529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.147757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.147962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.148165 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.148353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.148632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.148823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.149008 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.149201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.149201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.149598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.149865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.150073 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.150259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.150456 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.150789 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.150994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.151182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.151367 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.151554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.151710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.151872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152034 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.152968 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.153118 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.153276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.153427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.153585 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.153751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.153902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.154102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.154363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.154528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.154689 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.154855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155335 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155504 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155837 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.155999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.156150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.156475 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.156634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.156634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.156937 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.157096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.157259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.157563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.157731 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.157899 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.158971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.159128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.159279 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.159487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.159659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.159812 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.159970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.160129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.160280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.160438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.160597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.160766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161337 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.161993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.162144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.162301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.162460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.162620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.162779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.162779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.163067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.163218 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.163381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.163569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.163734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.163885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.164044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.164916 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.165106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.165298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.165451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.165612 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.165775 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.165937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.166118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.166272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.166623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.166784 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.166937 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.167087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.167250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.167410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.167768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.167937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.168097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.168250 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.168408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.168578 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.168739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.168898 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.169058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.169058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.169058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.169519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.169694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.169852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.170003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.170803 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.170972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.171298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.171496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.171656 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.171807 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.171969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.172120 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.172284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.172444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.172603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.172754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.172903 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.173053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.173217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.173376 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.173539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.173690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.173848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.174007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.174179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.174331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.174482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.177250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.177450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.177622 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.178058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.178219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.178381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.178558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.178722 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.178883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179028 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.179936 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.180639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.181951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182307 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182511 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182789 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.182981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183162 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183248 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183434 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.183910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.184909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.185540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.185642 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.185750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.185837 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.185924 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186022 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.186525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.187986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.188986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189511 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.189933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.190792 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.191031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.191154 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.191370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.191646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.191744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.192047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.192140 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.192375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.192555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.192693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193139 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193442 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.193984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.194306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.194448 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.194618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.194905 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.195008 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.195261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.195353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.195600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.195843 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.196017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.196214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.196371 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.196640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.196775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.196957 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.197101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.197288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.197643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.197643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.198354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.198354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.198637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.198778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.198908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199168 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199464 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.199923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200060 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200205 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200509 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.200891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.201199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.201544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.201867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202179 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.202962 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.203115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.203269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.203423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.203706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.203854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.203997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.204149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.204322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.204569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.204727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.204881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.205158 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.205491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.205824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.205983 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.206177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.206329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.206493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.206654 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.206845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.206997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.207179 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.207380 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.207603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.208015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.208166 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.208319 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.208464 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.208661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.208811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 16:07:09.208965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.209117 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.209425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.209764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.210078 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.210391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.210712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.211024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.211334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.211672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.212015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.212329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.212640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.212948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.213282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.213593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.213923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.214241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.214554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.214865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.215174 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.215547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.215859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.216260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.216511 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.216843 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.217163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.217485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.217807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.218124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.218445 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.218874 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.219201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.219553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.219864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.220184 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.220509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.221093 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.221427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.221755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.222077 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.222397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.222718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.223038 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.223356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.223727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.224044 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.224361 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.224699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.225027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.225361 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.225719 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.226027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.226360 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.226669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.226988 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.227353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.227788 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.228092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.228415 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.228766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.229086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.229402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.229715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.230037 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.230353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.230670 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.230983 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.231300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.231643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.231972 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.232314 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.232639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.232957 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.233274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.233593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.234116 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.234435 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.234773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.235106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.235560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.235809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.236130 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.236503 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.236772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.237079 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.237392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.237708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.238014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.238310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.238623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.238930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.239256 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.239587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.240129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.240494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.240806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.241136 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.241462 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.241778 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.242088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.242427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.242726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.243034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.243381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.243710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.244020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.244331 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.244648 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.244961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.245266 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.245581 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.245889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.246223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.246587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.246835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.247142 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.247470 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.247783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.248090 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.248398 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.248702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.249017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.249321 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.249727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.250042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.250342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.250691 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.251004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.251309 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.251658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.251981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.252288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.252607 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.252918 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.253243 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.253557 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.253870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.254218 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.254537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.255073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.255410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.255754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.256090 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.256424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.256739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.257045 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.257350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.257679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.257990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.258300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.258611 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.258981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.259282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.259618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.259933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.260241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.260551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.260863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.261173 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.261484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.261793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.262103 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.262420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.262764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.263084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.263403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.263742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.264058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.264370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.264679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.264990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.265302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.265619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.265951 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.266271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.266579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.267010 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.267323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.267667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.267990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.268302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.268622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.268944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.269260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.269581 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.269852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO dbcounter [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Registered counter for database nova_api Sep 08 16:07:09.269957 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.270210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.270550 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.270879 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.271206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.271536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.271847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.272156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.272467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.272786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.273096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.273400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.273702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.274012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.274317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.274650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.274957 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.275313 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.275595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.275901 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.276211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.276518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.276835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.277128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.277432 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.277741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.278046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.278354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.278659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.278966 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.279272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.279633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.279971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.280289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.280612 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.280925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.281249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.281561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.281887 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.282210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.282527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.282839 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.283176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.283509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.283824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.284139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.284451 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.284766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.285340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.285506 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.285840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.286156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.286487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.286809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.287149 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.287471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.287783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.288121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.288431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.288744 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.289056 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.290737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.290737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.290737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.290737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.291271 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.291407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.291407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.291407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.291813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.291950 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.292187 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.292515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.292844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.293194 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.293508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.293856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.294185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.294502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.294811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.295118 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 16:07:09.295363 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 16:07:09.297590 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.354800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.context [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8767b60e-3134-411b-81c6-9212f447c551(cell1) {{(pid=120783) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 16:07:09.356834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO dbcounter [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Registered counter for database nova_api Sep 08 16:07:09.358832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:07:09.359315 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:07:09.360935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:07:09.361679 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:07:09.362128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:07:09.364164 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:07:09.366235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO dbcounter [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Registered counter for database nova_cell0 Sep 08 16:07:09.370297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO dbcounter [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Registered counter for database nova_cell1 Sep 08 16:07:09.378047 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.379337 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.381582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.386317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.387864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.445339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.context [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8767b60e-3134-411b-81c6-9212f447c551(cell1) {{(pid=120782) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 16:07:09.449824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:07:09.450303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:07:09.451938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:07:09.452682 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:07:09.453129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:07:09.455370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:07:09.457170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO dbcounter [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Registered counter for database nova_cell0 Sep 08 16:07:09.461190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO dbcounter [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Registered counter for database nova_cell1 Sep 08 16:07:09.468745 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.470224 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.476799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.478440 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.526542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.536770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO dbcounter [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Registered counter for database nova_cell0 Sep 08 16:07:09.543873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_db.sqlalchemy.engines [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.548725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writer thread running {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.624892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO dbcounter [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Registered counter for database nova_cell0 Sep 08 16:07:09.632670 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_db.sqlalchemy.engines [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 16:07:09.638460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writer thread running {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 16:07:09.868665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:07:09.876318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:07:09.950073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:07:09.957409 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:07:10.224787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:07:10.231064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: WARNING keystonemiddleware.auth_token [None req-01ffb7cb-b68b-46ea-a306-924eec4932c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:07:10.236558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfd663d9c0 pid: 120783 (default app) Sep 08 16:07:10.300978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 16:07:10.307138 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: WARNING keystonemiddleware.auth_token [None req-3a790cda-394d-411a-86ad-47b6aad7ce21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 16:07:10.312570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfd663d9c0 pid: 120782 (default app) Sep 08 16:07:46.306010 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.308214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.309583 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.310609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.438252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.442696 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.443781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:46.444717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:07:47.635066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93cf97b4-014b-45d1-8300-385469dc2b29 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Action: 'create', calling method: .version_select at 0x7f8861147430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940549532", "metadata": {"Type": "work"}}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93cf97b4-014b-45d1-8300-385469dc2b29 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Request method failure captured: Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 121 Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNS7D4NFHUQqM7aoSllIbuHE3ln7iF7W58sIt1UjUZlQSdtLZ2DmoihHv_TEz7njwwQscKR1aKQ4Uxgz91LBvnaaVer_zFTXZzlLCywBUNLaAnO-jF2zo6-r5gQReRWHobaiT8gB0UKITVCo3oGF27Fun1IW4ICRuY9KE1H__rpIB8 Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:47.644198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e604a196b20448caa9a0f2196b7f308e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}] Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2ffcc5ea76744215b8a4a7ea49982913 Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940549532", "metadata": {"Type": "work"}}} Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:47.646029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-940549532', 'metadata': {'Type': 'work'}}}} Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise error Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:47.647141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 16:07:47.653378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 16:07:47.656734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 16:07:47.656734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.656734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93cf97b4-014b-45d1-8300-385469dc2b29 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:47.658730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93cf97b4-014b-45d1-8300-385469dc2b29 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.370552 Sep 08 16:07:47.661030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 16:07:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1376 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:07:47.672757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1c58ad0d-9179-42a8-ba9f-329191e65de0 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Action: 'create', calling method: .version_select at 0x7f8861147d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-491305380", "metadata": {"Type": "work"}}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1c58ad0d-9179-42a8-ba9f-329191e65de0 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Request method failure captured: Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 119 Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNS7D4NFHUQqM7aoSllIbuHE3ln7iF7W58sIt1UjUZlQSdtLZ2DmoihHv_TEz7njwwQscKR1aKQ4Uxgz91LBvnaaVer_zFTXZzlLCywBUNLaAnO-jF2zo6-r5gQReRWHobaiT8gB0UKITVCo3oGF27Fun1IW4ICRuY9KE1H__rpIB8 Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:47.680021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e604a196b20448caa9a0f2196b7f308e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}] Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2ffcc5ea76744215b8a4a7ea49982913 Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-491305380", "metadata": {"Type": "work"}}} Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:47.681357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-491305380', 'metadata': {'Type': 'work'}}}} Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise error Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi '0' Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:47.682156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 16:07:47.683414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 16:07:47.684632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 16:07:47.684632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.684632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1c58ad0d-9179-42a8-ba9f-329191e65de0 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:47.684632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1c58ad0d-9179-42a8-ba9f-329191e65de0 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014102 Sep 08 16:07:47.684632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 16:07:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:07:47.693738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aba5c92a-20ef-406a-86be-f55dc8914231 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Action: 'create', calling method: .version_select at 0x7f8861000160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-146648302", "metadata": {"Type": "work"}}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aba5c92a-20ef-406a-86be-f55dc8914231 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Request method failure captured: Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 118 Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNS7D4NFHUQqM7aoSllIbuHE3ln7iF7W58sIt1UjUZlQSdtLZ2DmoihHv_TEz7njwwQscKR1aKQ4Uxgz91LBvnaaVer_zFTXZzlLCywBUNLaAnO-jF2zo6-r5gQReRWHobaiT8gB0UKITVCo3oGF27Fun1IW4ICRuY9KE1H__rpIB8 Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:47.702356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e604a196b20448caa9a0f2196b7f308e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}] Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2ffcc5ea76744215b8a4a7ea49982913 Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-146648302", "metadata": {"Type": "work"}}} Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:47.704268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-146648302', 'metadata': {'Type': 'work'}}}} Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise error Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi '' Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:47.705267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 16:07:47.707963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 16:07:47.710052 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 16:07:47.710052 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:47.712106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aba5c92a-20ef-406a-86be-f55dc8914231 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:47.713200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aba5c92a-20ef-406a-86be-f55dc8914231 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025502 Sep 08 16:07:47.715260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 16:07:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 16:07:47.725364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b1b55f0e-d1a5-49f4-91e1-af338fbcac53 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Calling method '.version_select at 0x7f8861000b80>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:47.818247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2a33fd77-6695-4f58-857f-4b5cfe68bd16 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Action: 'create', calling method: .version_select at 0x7f8861145430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-332080936"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:48.676820 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-b1b55f0e-d1a5-49f4-91e1-af338fbcac53 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] HTTP exception thrown: Volume tempest-invalid-1726900877 could not be found. Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b1b55f0e-d1a5-49f4-91e1-af338fbcac53 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Request method failure captured: Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1726900877 HTTP/1.1 Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNS7D4NFHUQqM7aoSllIbuHE3ln7iF7W58sIt1UjUZlQSdtLZ2DmoihHv_TEz7njwwQscKR1aKQ4Uxgz91LBvnaaVer_zFTXZzlLCywBUNLaAnO-jF2zo6-r5gQReRWHobaiT8gB0UKITVCo3oGF27Fun1IW4ICRuY9KE1H__rpIB8 Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:48.682874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e604a196b20448caa9a0f2196b7f308e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}] Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2ffcc5ea76744215b8a4a7ea49982913 Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Volume tempest-invalid-1726900877 could not be found. Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'tempest-invalid-1726900877'} Sep 08 16:07:48.684610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1726900877 could not be found. (HTTP 404) (Request-ID: req-ddc1f4ca-1f4b-4374-8fc3-7a9f19ac28b0) Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:48.685539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 16:07:48.687178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1726900877 could not be found. Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:48.688549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1726900877 could not be found. Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1726900877 could not be found. Sep 08 16:07:48.690637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.692749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b1b55f0e-d1a5-49f4-91e1-af338fbcac53 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Returning 404 to user: Volume tempest-invalid-1726900877 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:48.702496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b1b55f0e-d1a5-49f4-91e1-af338fbcac53 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1726900877" status: 404 len: 99 microversion: 2.1 time: 0.980626 Sep 08 16:07:48.709123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 16:07:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1726900877 => generated 99 bytes in 989 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 16:07:48.716525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-de2600ce-7062-4d88-8b85-5f739aeeb5a6 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005872 Sep 08 16:07:48.717505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 16:07:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 16:07:48.735817 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e2b22629-793c-488e-aac8-677413372fe0 tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012374 Sep 08 16:07:48.740936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1137 bytes} [Thu Sep 8 16:07:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 08 16:07:48.747958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8bfdf6b8-da9f-4fe5-b0d0-800fc3bdc75d tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Calling method '.version_select at 0x7f8860f86dc0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:48.873422 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-8bfdf6b8-da9f-4fe5-b0d0-800fc3bdc75d tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] HTTP exception thrown: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8bfdf6b8-da9f-4fe5-b0d0-800fc3bdc75d tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Request method failure captured: Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/os-volumes/22fffcb2-d616-4b6f-b88f-6fd52c6e066a HTTP/1.1 Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNS7D4NFHUQqM7aoSllIbuHE3ln7iF7W58sIt1UjUZlQSdtLZ2DmoihHv_TEz7njwwQscKR1aKQ4Uxgz91LBvnaaVer_zFTXZzlLCywBUNLaAnO-jF2zo6-r5gQReRWHobaiT8gB0UKITVCo3oGF27Fun1IW4ICRuY9KE1H__rpIB8 Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:48.875825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e604a196b20448caa9a0f2196b7f308e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}] Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2ffcc5ea76744215b8a4a7ea49982913 Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '22fffcb2-d616-4b6f-b88f-6fd52c6e066a'} Sep 08 16:07:48.877342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. (HTTP 404) (Request-ID: req-760d61c6-c6d5-4045-865c-b4c8a6300af0) Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:48.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 16:07:48.879568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 16:07:48.880865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. Sep 08 16:07:48.882142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:48.884319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8bfdf6b8-da9f-4fe5-b0d0-800fc3bdc75d tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Returning 404 to user: Volume 22fffcb2-d616-4b6f-b88f-6fd52c6e066a could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:48.885541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8bfdf6b8-da9f-4fe5-b0d0-800fc3bdc75d tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/22fffcb2-d616-4b6f-b88f-6fd52c6e066a" status: 404 len: 109 microversion: 2.1 time: 0.143597 Sep 08 16:07:48.886268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 7/7] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:07:48 2022] DELETE /compute/v2.1/os-volumes/22fffcb2-d616-4b6f-b88f-6fd52c6e066a => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:07:48.899793 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e16fdcc9-d0b5-430c-8652-85b64acffdae tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Calling method '.version_select at 0x7f8860f35310>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:48.995781 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-e16fdcc9-d0b5-430c-8652-85b64acffdae tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] HTTP exception thrown: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e16fdcc9-d0b5-430c-8652-85b64acffdae tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Request method failure captured: Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/os-volumes/b092cded-c7c4-429c-8982-ce76fb425587 HTTP/1.1 Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNS7D4NFHUQqM7aoSllIbuHE3ln7iF7W58sIt1UjUZlQSdtLZ2DmoihHv_TEz7njwwQscKR1aKQ4Uxgz91LBvnaaVer_zFTXZzlLCywBUNLaAnO-jF2zo6-r5gQReRWHobaiT8gB0UKITVCo3oGF27Fun1IW4ICRuY9KE1H__rpIB8 Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:48.998502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e604a196b20448caa9a0f2196b7f308e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e604a196b20448caa9a0f2196b7f308e"}]}] Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: e604a196b20448caa9a0f2196b7f308e Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-1345557433 Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2ffcc5ea76744215b8a4a7ea49982913 Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-1345557433-project Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'b092cded-c7c4-429c-8982-ce76fb425587'} Sep 08 16:07:49.000039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. (HTTP 404) (Request-ID: req-f854cc29-8698-41eb-ab69-85566289b7e3) Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:49.000908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:49.002232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 16:07:49.003635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e16fdcc9-d0b5-430c-8652-85b64acffdae tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] Returning 404 to user: Volume b092cded-c7c4-429c-8982-ce76fb425587 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:49.005684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e16fdcc9-d0b5-430c-8652-85b64acffdae tempest-VolumesNegativeTest-1345557433 tempest-VolumesNegativeTest-1345557433-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b092cded-c7c4-429c-8982-ce76fb425587" status: 404 len: 109 microversion: 2.1 time: 0.107961 Sep 08 16:07:49.008836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 8/8] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:07:48 2022] GET /compute/v2.1/os-volumes/b092cded-c7c4-429c-8982-ce76fb425587 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:07:49.690951 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2a33fd77-6695-4f58-857f-4b5cfe68bd16 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.264150 Sep 08 16:07:49.692549 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 1/9] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Sep 8 16:07:46 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3268 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 08 16:07:49.710779 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8917a498-473b-497e-bf81-cb1e6154e851 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f86820>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:49.847981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8917a498-473b-497e-bf81-cb1e6154e851 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 200 len: 344 microversion: 2.1 time: 0.141024 Sep 08 16:07:49.848604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 9/10] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:07:49 2022] GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:50.868873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9e3aabb6-6d5a-40e3-a8aa-a8f4eaf34169 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8861015310>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:50.951299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9e3aabb6-6d5a-40e3-a8aa-a8f4eaf34169 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 200 len: 345 microversion: 2.1 time: 0.091689 Sep 08 16:07:50.952712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 2/11] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:07:50 2022] GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:50.971044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-850c220e-496c-462a-a874-76cbecd1565c tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Action: 'create', calling method: .version_select at 0x7f8860f86ee0>, body: {"snapshot": {"volume_id": "47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-227999862"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:07:51.683375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-850c220e-496c-462a-a874-76cbecd1565c tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.720756 Sep 08 16:07:51.684774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 10/12] 10.222.0.27 () {60 vars in 1162 bytes} [Thu Sep 8 16:07:50 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:07:51.697504 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a118833-ea12-4895-8fa8-a99ea46bd2d1 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f88610159d0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:52.117311 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1a118833-ea12-4895-8fa8-a99ea46bd2d1 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 200 len: 286 microversion: 2.1 time: 0.424629 Sep 08 16:07:52.117932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 3/13] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:51 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 286 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:52.129408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ad227c30-324c-4731-93c6-39c31b0c2dd0 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f370d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:52.225474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ad227c30-324c-4731-93c6-39c31b0c2dd0 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099875 Sep 08 16:07:52.226070 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 11/14] 10.222.0.27 () {58 vars in 1140 bytes} [Thu Sep 8 16:07:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:52.237883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ed32c956-6878-4ea3-a6cb-57497f8d9639 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860fb0160>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:52.286955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ed32c956-6878-4ea3-a6cb-57497f8d9639 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 200 len: 286 microversion: 2.1 time: 0.053013 Sep 08 16:07:52.293086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 4/15] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:52 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:53.299747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fd527e0-20cc-40b5-8182-9702374521b7 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f37820>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:53.346674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0fd527e0-20cc-40b5-8182-9702374521b7 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 200 len: 286 microversion: 2.1 time: 0.050515 Sep 08 16:07:53.347886 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 12/16] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:53 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:54.361191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-26ff7979-9fdd-4271-bab4-2ea1b8796fd5 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8861015ca0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:54.403906 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-26ff7979-9fdd-4271-bab4-2ea1b8796fd5 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 200 len: 286 microversion: 2.1 time: 0.046453 Sep 08 16:07:54.404751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 5/17] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:54 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:55.417614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b1c495ab-a5ca-4781-99d8-3f68c27e3183 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f86af0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:55.486055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b1c495ab-a5ca-4781-99d8-3f68c27e3183 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 200 len: 287 microversion: 2.1 time: 0.073319 Sep 08 16:07:55.487671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 13/18] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:55 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:55.507772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5b48637e-bf7f-4159-ad41-57aa1f80bbb3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f88610155e0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:55.677628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5b48637e-bf7f-4159-ad41-57aa1f80bbb3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 202 len: 0 microversion: 2.1 time: 0.182872 Sep 08 16:07:55.678676 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 6/19] 10.222.0.27 () {58 vars in 1254 bytes} [Thu Sep 8 16:07:55 2022] DELETE /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:07:55.694353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b6b642ae-73c8-41b2-afb9-19079682d13b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f86a60>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:55.767548 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b6b642ae-73c8-41b2-afb9-19079682d13b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 200 len: 286 microversion: 2.1 time: 0.084284 Sep 08 16:07:55.772711 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 14/20] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:55 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:56.786967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-14eb18a0-5049-440f-8946-0dc704077036 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860fb0430>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:56.841215 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-14eb18a0-5049-440f-8946-0dc704077036 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] HTTP exception thrown: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-14eb18a0-5049-440f-8946-0dc704077036 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Request method failure captured: Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 HTTP/1.1 Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNSwi_b83bO4d-xpYv4742U2Hrx5qgdguxsYPhV75y8GkLB_0u6qjB7jp984p5xZmQhJxr6ApLHz8WxQ3HbTl1C8CzSKDdXj6t33drgvZj3mQeihpXjisZv9Em9o4feJE4dwxKEHZd-v-Q2YIrzVjGjgbWolcev7QQc_xbT4Co-ODg Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:07:56.846042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f22c36df7bc547f6abd9533d0730a077", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}] Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 44e6d392d538462a875805138980da85 Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '11b4dabe-5aa6-42ce-9ca0-39e7890930c9'} Sep 08 16:07:56.847244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. (HTTP 404) (Request-ID: req-51174c92-01d0-48b6-a701-81d4c34f48fa) Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.847990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:56.849569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 16:07:56.850499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-14eb18a0-5049-440f-8946-0dc704077036 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Returning 404 to user: Snapshot 11b4dabe-5aa6-42ce-9ca0-39e7890930c9 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-14eb18a0-5049-440f-8946-0dc704077036 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9" status: 404 len: 111 microversion: 2.1 time: 0.071119 Sep 08 16:07:56.852546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 7/21] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:07:56 2022] GET /compute/v2.1/os-snapshots/11b4dabe-5aa6-42ce-9ca0-39e7890930c9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:07:56.858361 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-924e9ce7-997c-4586-aea4-e1b92b19f68d tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860fd3790>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:56.988497 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-924e9ce7-997c-4586-aea4-e1b92b19f68d tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 202 len: 0 microversion: 2.1 time: 0.135411 Sep 08 16:07:56.990869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 15/22] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:07:56 2022] DELETE /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:07:57.001328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-46cd19de-01d7-4a41-b97d-2e1e4595abc6 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860fb0a60>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:57.134135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-46cd19de-01d7-4a41-b97d-2e1e4595abc6 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 200 len: 344 microversion: 2.1 time: 0.139032 Sep 08 16:07:57.135206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 8/23] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:07:56 2022] GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:07:58.150942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5ad96f76-f8c9-4d77-827f-33cd27e7cfc3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f373a0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:58.250829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-5ad96f76-f8c9-4d77-827f-33cd27e7cfc3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] HTTP exception thrown: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5ad96f76-f8c9-4d77-827f-33cd27e7cfc3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Request method failure captured: Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 HTTP/1.1 Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNSwi_b83bO4d-xpYv4742U2Hrx5qgdguxsYPhV75y8GkLB_0u6qjB7jp984p5xZmQhJxr6ApLHz8WxQ3HbTl1C8CzSKDdXj6t33drgvZj3mQeihpXjisZv9Em9o4feJE4dwxKEHZd-v-Q2YIrzVjGjgbWolcev7QQc_xbT4Co-ODg Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:58.253354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f22c36df7bc547f6abd9533d0730a077", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}] Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 44e6d392d538462a875805138980da85 Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5'} Sep 08 16:07:58.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. (HTTP 404) (Request-ID: req-47f5016a-1e81-40f8-99c4-c8ed3c688f7f) Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.257408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:58.260339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 16:07:58.264003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5ad96f76-f8c9-4d77-827f-33cd27e7cfc3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Returning 404 to user: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5ad96f76-f8c9-4d77-827f-33cd27e7cfc3 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 404 len: 109 microversion: 2.1 time: 0.108034 Sep 08 16:07:58.267643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 16/24] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:07:58 2022] GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:07:58.270463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0b303fde-f08b-4e7d-bf22-011aa2a7f63b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f94160>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:58.361383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-0b303fde-f08b-4e7d-bf22-011aa2a7f63b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] HTTP exception thrown: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0b303fde-f08b-4e7d-bf22-011aa2a7f63b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Request method failure captured: Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 HTTP/1.1 Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNSwi_b83bO4d-xpYv4742U2Hrx5qgdguxsYPhV75y8GkLB_0u6qjB7jp984p5xZmQhJxr6ApLHz8WxQ3HbTl1C8CzSKDdXj6t33drgvZj3mQeihpXjisZv9Em9o4feJE4dwxKEHZd-v-Q2YIrzVjGjgbWolcev7QQc_xbT4Co-ODg Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:07:58.364170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f22c36df7bc547f6abd9533d0730a077", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}] Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 44e6d392d538462a875805138980da85 Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5'} Sep 08 16:07:58.365546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. (HTTP 404) (Request-ID: req-97027861-9aee-48cb-a68f-95074a38be9e) Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.366147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 16:07:58.367122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 16:07:58.368121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.369139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.371791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0b303fde-f08b-4e7d-bf22-011aa2a7f63b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Returning 404 to user: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:58.372850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0b303fde-f08b-4e7d-bf22-011aa2a7f63b tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 404 len: 109 microversion: 2.1 time: 0.107741 Sep 08 16:07:58.382547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4a1401c6-6871-4981-970a-4bf6ae4c77c4 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Calling method '.version_select at 0x7f8860f868b0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:07:58.386238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 9/25] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:07:58 2022] DELETE /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:07:58.418900 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-4a1401c6-6871-4981-970a-4bf6ae4c77c4 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] HTTP exception thrown: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4a1401c6-6871-4981-970a-4bf6ae4c77c4 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Request method failure captured: Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 HTTP/1.1 Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNSwi_b83bO4d-xpYv4742U2Hrx5qgdguxsYPhV75y8GkLB_0u6qjB7jp984p5xZmQhJxr6ApLHz8WxQ3HbTl1C8CzSKDdXj6t33drgvZj3mQeihpXjisZv9Em9o4feJE4dwxKEHZd-v-Q2YIrzVjGjgbWolcev7QQc_xbT4Co-ODg Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:07:58.421222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f22c36df7bc547f6abd9533d0730a077", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f22c36df7bc547f6abd9533d0730a077"}]}] Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: f22c36df7bc547f6abd9533d0730a077 Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-560954867 Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 44e6d392d538462a875805138980da85 Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesSnapshotsTestJSON-560954867-project Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5'} Sep 08 16:07:58.423237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. (HTTP 404) (Request-ID: req-e0f57da0-3466-4801-b2a3-24be2cd27fe7) Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.425111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:07:58.426867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 16:07:58.431478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4a1401c6-6871-4981-970a-4bf6ae4c77c4 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] Returning 404 to user: Volume 47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4a1401c6-6871-4981-970a-4bf6ae4c77c4 tempest-VolumesSnapshotsTestJSON-560954867 tempest-VolumesSnapshotsTestJSON-560954867-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5" status: 404 len: 109 microversion: 2.1 time: 0.045748 Sep 08 16:07:58.435411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 17/26] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:07:58 2022] GET /compute/v2.1/os-volumes/47f53af9-e780-4ed5-84f1-2f7ab0dc9ac5 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:08:03.642335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-979047267", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "networks": [{"uuid": "5ac9a14b-ec82-4c2f-830e-82d77fe152c1"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:03.947773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] validate_networks() for [('5ac9a14b-ec82-4c2f-830e-82d77fe152c1', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:08:06.999757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3797c1ac-72ed-4e63-9460-60d87ea817a0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: .version_select at 0x7f8860f371f0>, body: {"keypair": {"name": "tempest-keypair-672068844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGb7Afkxy7pQM0YapXkvrW2Wm/uhNZagSBnqUY4thlYGDveBPA566QCbfbs4Bu5IQ8kaN9LwbgenWNr05MdabwOsHlo2dFFosZLwTElLdC/E4NFCQf2mUKZtA6mYyN1eFQ=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:07.115901 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:08:07.116967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:08:07.119229 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:08:07.120454 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:08:07.122230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:08:07.161647 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-3797c1ac-72ed-4e63-9460-60d87ea817a0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:07.194241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-3797c1ac-72ed-4e63-9460-60d87ea817a0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:07.194464 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:07.195148 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:07.196378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:07.200454 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:07.202328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:07.202865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:07.347906 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Getting quotas for project be0b2aab8dbf41a7a3c590ca61f022f8. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:07.362461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Getting quotas for user 675b1a5759844cdaa7e0bf071a3ee030 and project be0b2aab8dbf41a7a3c590ca61f022f8. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:07.381596 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3797c1ac-72ed-4e63-9460-60d87ea817a0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.724869 Sep 08 16:08:07.382598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 18/27] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:08:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:07.391841 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:08:07.394072 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:08:07.647102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e4d22818-2e77-4c88-8544-84f3d7d8bba2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.356903 Sep 08 16:08:07.647888 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 10/28] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:08:07.662681 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-93ee430d-c3e0-4c34-bac1-1cc6385859b6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:07.663477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-93ee430d-c3e0-4c34-bac1-1cc6385859b6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:08.009762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-93ee430d-c3e0-4c34-bac1-1cc6385859b6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:08.064379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-93ee430d-c3e0-4c34-bac1-1cc6385859b6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1214 microversion: 2.1 time: 0.404901 Sep 08 16:08:08.075177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 19/29] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:07 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1214 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:08.713582 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-885474453", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:08.817739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] validate_networks() for [('260167e2-5383-42f8-9445-7b6fc1d605d2', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:08:09.093636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-18d468f8-f5b8-43f8-aacc-84376e3cd5a5 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:09.097224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-18d468f8-f5b8-43f8-aacc-84376e3cd5a5 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:09.209308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-18d468f8-f5b8-43f8-aacc-84376e3cd5a5 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:09.218512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-18d468f8-f5b8-43f8-aacc-84376e3cd5a5 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1214 microversion: 2.1 time: 0.131782 Sep 08 16:08:09.238171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 20/30] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:09 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:09.863836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a188411-5857-49e1-9b4c-ac46e0de451f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'create', calling method: .version_select at 0x7f8860e8a670>, body: {"keypair": {"name": "tempest-keypair-1412213229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnExSDHValiAPj0B+cbgWjyx3FMC2QWgu3PLrPaBIJm4Gg+xyr2blw8UPlo7pgS1jGeQ+xEyvU/DPqo0/+tqfj1WEDGmhdiGtn2kQXzWIVSX6LvFpnb+GdqOTs0ORS4LA=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:09.904241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-0a188411-5857-49e1-9b4c-ac46e0de451f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for project 52651960a8b6494193c5e8abc658a2dd. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:09.912260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-0a188411-5857-49e1-9b4c-ac46e0de451f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for user c89859a30a2442b8ae13fe0444782d9c and project 52651960a8b6494193c5e8abc658a2dd. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:09.976447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0a188411-5857-49e1-9b4c-ac46e0de451f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.239949 Sep 08 16:08:09.984716 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 21/31] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 16:08:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 16:08:10.109668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:08:10.110642 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:08:10.111342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:08:10.112084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:08:10.112641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:08:10.140943 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:10.142782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:10.144703 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:10.146857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:10.147578 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:10.148163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:10.170272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for project 73c9cf0f579144eb80c090456d363a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:10.179498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for user 18375266a64348df879a9eec53bfcbf9 and project 73c9cf0f579144eb80c090456d363a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:10.245005 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:08:10.253328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:10.254890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:10.264916 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:08:10.268221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:10.268725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:10.269161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:10.269876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:10.270328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:10.270769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:10.437523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b0dd392e-0d98-484b-8a82-ac1a069da377 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.824827 Sep 08 16:08:10.457563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 11/32] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:08:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:08:10.462529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9bf4872e-522b-4d38-a925-396172021818 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:10.463150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9bf4872e-522b-4d38-a925-396172021818 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:10.747227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:10.767298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0ec2fba7-da7e-45a0-90c0-e5d4848b24b7 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1218 microversion: 2.1 time: 0.521043 Sep 08 16:08:10.800269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9bf4872e-522b-4d38-a925-396172021818 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:10.812033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 22/33] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:10 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1218 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:10.878650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9bf4872e-522b-4d38-a925-396172021818 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1221 microversion: 2.1 time: 0.419863 Sep 08 16:08:10.882063 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 12/34] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:10 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1221 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:11.184899 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1071690525", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:11.409067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] validate_networks() for [('260167e2-5383-42f8-9445-7b6fc1d605d2', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:08:11.828000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:11.829461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:11.843124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:11.844081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:11.846418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:11.850728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:11.852132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:11.852853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:12.348387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:12.380747 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1ed4cc59-10f4-4d84-b8ba-e38dc5c1a9ab tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1218 microversion: 2.1 time: 0.559778 Sep 08 16:08:12.383384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 13/35] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:11 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1218 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:13.341484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-438746569", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a88764e-b620-4723-a684-b37f114bda88"}], "security_groups": [{"name": "tempest-securitygroup--1039015324"}], "key_name": "tempest-keypair-672068844", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:13.595566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] validate_networks() for [('2a88764e-b620-4723-a684-b37f114bda88', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:08:13.863339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:08:13.863848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:08:13.864283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:08:13.864761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:08:13.865090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:08:13.889798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:13.890235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:13.890670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:13.898500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:13.899540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:13.900148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:13.978183 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for project 73c9cf0f579144eb80c090456d363a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:13.988771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for user 18375266a64348df879a9eec53bfcbf9 and project 73c9cf0f579144eb80c090456d363a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:14.024696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:08:14.036186 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:08:14.176067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3f044f38-40cb-4031-bd3e-b0a38201bc23 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.010429 Sep 08 16:08:14.182691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 23/36] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:08:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:08:14.182691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:14.182926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:14.211215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:14.224569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:14.225328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:14.227303 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:14.228597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:14.229324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:14.637855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:14.650425 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-984d677d-9130-465e-b2be-d6ec1222bf75 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1272 microversion: 2.1 time: 0.471518 Sep 08 16:08:14.652721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 24/37] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:14 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1272 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:14.677863 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-85001638", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9577f7e-a12c-4f63-bec7-ce8faba76cc5"}], "security_groups": [{"name": "tempest-securitygroup--2031637292"}], "key_name": "tempest-keypair-1412213229", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:15.238578 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:08:15.239837 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:08:15.241394 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:08:15.242096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:08:15.242982 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:08:15.262885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:15.263753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:15.264509 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] validate_networks() for [('f9577f7e-a12c-4f63-bec7-ce8faba76cc5', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:08:15.265471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:15.266479 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:15.267155 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:15.267868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:15.294191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:15.307020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:15.337917 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:08:15.344499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:08:15.540061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5f93bcbf-6d95-4d71-b66b-fba869dc0bfc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.202875 Sep 08 16:08:15.540655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 14/38] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:08:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 2205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:08:15.561088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:15.561730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:15.588202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:15.594222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:15.594920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:15.596217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:15.609874 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:15.610621 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:15.871942 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:15.887767 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-583a5262-344c-40aa-bf37-f6b73704ea6c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1226 microversion: 2.1 time: 0.342209 Sep 08 16:08:15.892019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 15/39] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:15 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1226 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:15.911649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-06cf8d7c-b101-49ad-838e-3d3833fc0bca tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:15.916743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-06cf8d7c-b101-49ad-838e-3d3833fc0bca tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:16.154900 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-06cf8d7c-b101-49ad-838e-3d3833fc0bca tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:16.163091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-06cf8d7c-b101-49ad-838e-3d3833fc0bca tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1240 microversion: 2.1 time: 0.268483 Sep 08 16:08:16.190121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 16/40] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:15 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1240 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:16.204339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:16.222240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:16.241531 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:16.242189 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:16.242434 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:16.254666 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:16.256502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:16.260327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:16.460773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:16.473863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7e4dd9ad-f72e-4d06-84fd-603264533f6a tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1272 microversion: 2.1 time: 0.282491 Sep 08 16:08:16.475128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 17/41] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:16 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:16.919961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:16.920831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:16.950341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:16.952695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:16.954652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:16.955689 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:16.962443 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:16.963240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:17.527495 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:17.552884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-61db6e06-dee6-4cd4-b52b-96e079a37b20 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1282 microversion: 2.1 time: 0.644150 Sep 08 16:08:17.561075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 18/42] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:16 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1282 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:17.595615 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:17.598927 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:17.681366 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:17.683799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:17.686876 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:17.691424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:17.694442 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:17.697725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:17.935932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:17.955086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-42500000-ebcc-4b09-bfca-34758cb4e8cb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1236 microversion: 2.1 time: 0.386933 Sep 08 16:08:17.956692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 19/43] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:17 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1236 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:17.976542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:18.015468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:18.042000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:18.043793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:18.048638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:18.052425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:18.053215 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:18.055105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:18.807252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:18.817206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-338b3a41-9b0b-4e6b-aa32-db0396d4596d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.858225 Sep 08 16:08:18.822986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 20/44] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:17 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:18.844816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:18.845440 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:18.877163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:18.877664 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:18.878200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:18.878820 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:18.879284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:18.879747 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:19.030130 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:19.043304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7de88486-4ec5-45fb-8778-30d922c36e99 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1280 microversion: 2.1 time: 0.216703 Sep 08 16:08:19.061655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 21/45] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:18 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:19.067009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:19.067894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:19.075247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:19.076305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:19.077235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:19.078616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:19.079246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:19.079856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:19.272205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:19.288660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0f65eb4a-bf58-4f3f-9130-40dcbb12d24a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1292 microversion: 2.1 time: 0.220832 Sep 08 16:08:19.307152 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 22/46] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:19 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1292 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:19.859206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:19.860014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:19.888668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:19.889494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:19.891203 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:19.894715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:19.895214 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:19.901058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:20.320706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:08:20.321666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:08:20.322240 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:08:20.322779 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:08:20.323304 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:08:20.358851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:20.359926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:20.360478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:20.361562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:20.362787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:20.363428 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:20.444497 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for project 52651960a8b6494193c5e8abc658a2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:20.476053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for user c89859a30a2442b8ae13fe0444782d9c and project 52651960a8b6494193c5e8abc658a2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:20.502933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:08:20.517451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:08:20.649188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:20.651207 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-452304bb-a095-4780-b15f-a821fef22a55 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.995973 Sep 08 16:08:20.652064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 25/47] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 16:08:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 5999 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 16:08:20.663855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0a63540a-e669-488c-9458-94702151753c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.817091 Sep 08 16:08:20.665069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:19 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:20.679825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:20.680869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:20.689510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:20.690633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:20.691399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:20.692379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:20.693043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:20.693625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:20.705887 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:20.706933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:20.721032 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:20.721675 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:20.722598 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:20.727433 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:20.728213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:20.729006 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:21.146552 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:21.193223 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6ba784d3-81c5-4817-a9a3-43adf5d20a07 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1280 microversion: 2.1 time: 0.535265 Sep 08 16:08:21.194463 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 26/49] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:20 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1280 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:21.202820 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7d3927b0-12c4-4378-8a42-e0d549543ef6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:21.206019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7d3927b0-12c4-4378-8a42-e0d549543ef6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:21.366839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7d3927b0-12c4-4378-8a42-e0d549543ef6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:21.396253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7d3927b0-12c4-4378-8a42-e0d549543ef6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:21.403384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7d3927b0-12c4-4378-8a42-e0d549543ef6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:21.404745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7d3927b0-12c4-4378-8a42-e0d549543ef6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1280 microversion: 2.20 time: 0.209005 Sep 08 16:08:21.406046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:21.425523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-12b04743-7ad1-4646-824f-e02f958f3bd3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1298 microversion: 2.1 time: 0.759115 Sep 08 16:08:21.433910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 24/50] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:20 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1298 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:21.456527 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 27/51] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:21 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:21.691313 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:21.692097 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:21.706158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:21.706715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:21.707180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:21.707950 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:21.716996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:21.717515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:22.224152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:22.225247 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:22.241004 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:22.243278 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:22.244035 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:22.247810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:22.248622 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:22.249313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:23.063472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:23.078833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa650257-56f5-48e6-bc26-5947ba284c5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1280 microversion: 2.1 time: 0.860641 Sep 08 16:08:23.086964 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 28/52] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:22 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1280 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:23.111591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:23.112276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:23.120922 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:23.121905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:23.121905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:23.123880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:23.124357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:23.124794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:23.242687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:23.259900 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:23.266740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:23.268463 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9f900eb3-375f-4c6e-9f6b-99333cedc9cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1332 microversion: 2.20 time: 0.180112 Sep 08 16:08:23.269647 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 29/53] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:23 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:23.280876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:23.282162 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:23.295268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:23.297167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:23.298529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:23.300395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:23.302778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:23.304418 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:23.412668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:23.426616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6f49f8e7-b4b8-4d24-b003-fdf11adb1ab3 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 1.742013 Sep 08 16:08:23.432992 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 25/54] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:21 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:23.536718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:23.547290 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e5f108cf-6027-4c0f-8096-d99db8e76d3e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1298 microversion: 2.1 time: 0.276353 Sep 08 16:08:23.552246 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 30/55] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:23 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1298 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:24.112551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:24.113511 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:24.143426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.144177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.144865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.173547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.178562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.179994 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.299186 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:24.300388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:24.310693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.328253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.337024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.339620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.341942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.342553 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.639862 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:24.657962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-55a24fea-f7b9-4813-b28e-426ca5a0635e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.542241 Sep 08 16:08:24.675473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 26/56] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:24 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:24.682651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:24.685783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:24.704209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:24.724244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:24.727719 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.730186 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.732715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:24.734757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.736278 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2caa5d0d-c1b1-4535-bec8-c8f6c36359d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1338 microversion: 2.20 time: 0.441752 Sep 08 16:08:24.738022 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.738491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 31/57] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:24 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1338 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:24.749052 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:24.749718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:24.761092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.762403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.788841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.792047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.795508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:24.796479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:24.796972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:24.797590 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:25.283167 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:26.159830 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=22 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:26.218159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:26.243434 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fe17f485-cd44-419d-b8ba-b80254766cc8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 1.502702 Sep 08 16:08:26.244456 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 32/58] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:24 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:26.251531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:26.252368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:26.277287 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:26.279633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:26.283690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:26.285515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:26.290313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:26.291924 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:26.626205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:26.657366 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-384ba7d5-0569-4ddb-b476-06a80329ba72 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 1.989673 Sep 08 16:08:26.665232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 27/59] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:24 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:26.689003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:26.695071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:26.716000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:26.720026 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:26.720491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:26.727547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:26.729338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:26.731103 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:27.122292 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:27.133681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:27.138971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:27.140193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f1e3b42f-739d-41c6-be6f-2cc5afd3880e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1338 microversion: 2.20 time: 0.471762 Sep 08 16:08:27.166354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 28/60] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:26 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1338 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:27.270690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:27.271892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:27.275839 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:27.288533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:27.290272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:27.291771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:27.292897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:27.295766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:27.296400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:27.441781 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:27.469305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3a43d944-fa4c-44f7-849e-9f4fdfb38cd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 1.223336 Sep 08 16:08:27.469918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 33/61] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:26 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:27.665683 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcc5ea9-0755-493f-9c67-4a0d0076df04", "tag": "069de4c6-aa5c-4db6-aed3-8e98f197a113"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:27.699674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:27.708930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:27.709468 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:27.778561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Creating event network-changed:069de4c6-aa5c-4db6-aed3-8e98f197a113 for instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 on hv-cinder-85625 Sep 08 16:08:27.779465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 16:08:27.780161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5e17118d-228f-4f65-8ca3-9c7375db00de req-b67d5d96-04ed-40b6-ae9a-cbfb406e5381 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 16:08:27.781493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:27.782238 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:27.782942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:27.785265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:27.786234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:27.786872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:27.802380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.compute.rpcapi [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 16:08:27.803721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] Releasing lock "compute-rpcapi-router" {{(pid=120783) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 16:08:27.827857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a1599a4f-36d4-4947-82bc-7057cdc8ed11 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275612 Sep 08 16:08:27.829456 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 34/62] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:28.215829 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:28.231568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b0b04f02-b0e0-497f-94f3-781737531ad5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.965815 Sep 08 16:08:28.235009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 29/63] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:27 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:28.251548 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-eeef8afd-9824-4709-b69e-e6d214425024 req-e9135855-4081-4b52-b761-450d44cbf467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e43cfdfd-dab3-4549-8e16-09873ba10625", "tag": "28d10c4d-3c67-4071-92ee-9fcbdcbec9af"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:28.265854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:28.271116 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:28.294321 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.296209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-eeef8afd-9824-4709-b69e-e6d214425024 req-e9135855-4081-4b52-b761-450d44cbf467 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.296896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.297347 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:28.297912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-eeef8afd-9824-4709-b69e-e6d214425024 req-e9135855-4081-4b52-b761-450d44cbf467 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.299296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-eeef8afd-9824-4709-b69e-e6d214425024 req-e9135855-4081-4b52-b761-450d44cbf467 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:28.300358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.304778 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.305334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:28.355582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-eeef8afd-9824-4709-b69e-e6d214425024 req-e9135855-4081-4b52-b761-450d44cbf467 service nova] Creating event network-changed:28d10c4d-3c67-4071-92ee-9fcbdcbec9af for instance e43cfdfd-dab3-4549-8e16-09873ba10625 on hv-cinder-85625 Sep 08 16:08:28.388651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-eeef8afd-9824-4709-b69e-e6d214425024 req-e9135855-4081-4b52-b761-450d44cbf467 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.555693 Sep 08 16:08:28.390223 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 35/64] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:28.400163 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:28.401107 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:28.406881 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:28.411012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.412012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.412787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:28.413882 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.414622 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.415296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:28.640777 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:28.666933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:28.681724 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:28.688417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-630a671f-4052-4b42-b4ae-67d28eafa2d3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1338 microversion: 2.20 time: 0.292952 Sep 08 16:08:28.690281 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 36/65] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:28 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1338 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:28.700979 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:28.706359 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:28.726394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.727472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.728613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:28.730606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:28.732063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:28.733881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:29.237903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:29.246524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-866a272b-ee9e-4e8b-902f-967e300444cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.554018 Sep 08 16:08:29.250279 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 37/66] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:28 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:29.290249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:29.290941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:29.313575 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:29.314350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:29.316922 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:29.320218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:29.321604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:29.324587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:29.702652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:29.715776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4fde349b-b1f3-4af7-9257-8ed823ff768f tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 1.479141 Sep 08 16:08:29.741379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 30/67] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:28 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:29.766016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:29.766623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:29.786595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:29.787534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:29.788194 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:29.790290 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:29.800230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:29.800929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:29.940578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:29.956768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c8dc4fbd-beca-4015-87b9-0f2beb992280 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.695271 Sep 08 16:08:29.958833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 38/68] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:29 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:30.024588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-ebbc5e63-7296-45bd-a7e2-dbe2225a5c1c req-996b4d72-aadf-4746-9a21-abbc3f6e5fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d36039-930c-4f96-93c3-c9fb893ae77c", "tag": "4478aeb3-30cc-4a4e-9707-bb149198bb14"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:30.039289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:30.048850 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ebbc5e63-7296-45bd-a7e2-dbe2225a5c1c req-996b4d72-aadf-4746-9a21-abbc3f6e5fee service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:30.049369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ebbc5e63-7296-45bd-a7e2-dbe2225a5c1c req-996b4d72-aadf-4746-9a21-abbc3f6e5fee service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:30.050080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ebbc5e63-7296-45bd-a7e2-dbe2225a5c1c req-996b4d72-aadf-4746-9a21-abbc3f6e5fee service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:30.068001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-ebbc5e63-7296-45bd-a7e2-dbe2225a5c1c req-996b4d72-aadf-4746-9a21-abbc3f6e5fee service nova] Creating event network-changed:4478aeb3-30cc-4a4e-9707-bb149198bb14 for instance 85d36039-930c-4f96-93c3-c9fb893ae77c on hv-cinder-85625 Sep 08 16:08:30.078663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-ebbc5e63-7296-45bd-a7e2-dbe2225a5c1c req-996b4d72-aadf-4746-9a21-abbc3f6e5fee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058719 Sep 08 16:08:30.079746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 39/69] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:08:30.283679 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:30.284454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:30.300523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:30.301033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:30.301461 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:30.302353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:30.308227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:30.309230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:30.830666 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:30.840794 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:30.845425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:30.849212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-004c2855-4eb1-4384-96cb-7caa104ff539 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 1.099780 Sep 08 16:08:30.852169 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 31/70] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:29 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:30.861299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387edd6e-7535-44c5-b75d-4a17415dd41c", "tag": "16a74b42-c0f4-435a-b6b7-c1c2856418c8"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:30.892388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:30.894657 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:30.898850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:30.945771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Creating event network-changed:16a74b42-c0f4-435a-b6b7-c1c2856418c8 for instance 387edd6e-7535-44c5-b75d-4a17415dd41c on hv-cinder-85625 Sep 08 16:08:30.948646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 16:08:30.950365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6e7e1836-3e44-42b6-b8dc-8536a0c5f49b req-202ad1b1-70e0-4da3-94e0-d43693dc6531 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 16:08:30.953551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:30.954241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:30.958942 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:30.960087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:30.960770 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:30.961393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:30.977992 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.compute.rpcapi [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 16:08:30.984431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120782) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 16:08:31.013807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0388675b-f24c-4e29-ad1f-2836d4da29f0 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159103 Sep 08 16:08:31.017956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 32/71] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:31.026057 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:31.027735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:31.045908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:31.046878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:31.049782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:31.053054 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:31.055516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:31.056064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:31.340256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:31.348985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-36b1781f-261b-4717-9b62-08dedc551387 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 1.073066 Sep 08 16:08:31.349625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 40/72] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:30 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:31.354814 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:31.356023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:31.362751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:31.363481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:31.364134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:31.365166 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:31.365840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:31.366512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:31.386946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=26 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:31.434922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:31.443120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-739c7b9c-0b55-43df-ba99-041d60262f2c tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.423599 Sep 08 16:08:31.452071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 33/73] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:31 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:31.636854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:31.652582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-986a26b4-52f9-4be9-baf8-8319acfac455 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.300849 Sep 08 16:08:31.657287 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 41/74] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:31 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:31.876373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:31.877665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:31.885189 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:31.885754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:31.886730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:31.887735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:31.888372 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:31.889106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.075132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:32.089459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:32.091758 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:32.093564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b233e172-ab74-4773-b0d1-5c69f4143bb6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.222319 Sep 08 16:08:32.096101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 34/75] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:31 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:32.374918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:32.376364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:32.385297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:32.386306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:32.387073 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.388278 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:32.388875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:32.389461 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.413981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:32.485295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:32.486235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:32.495732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:32.496801 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:32.497491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.498960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:32.499746 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:32.500524 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.592871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:32.607789 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5f1eca56-faed-4aa9-b544-49da7098937f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.237701 Sep 08 16:08:32.608800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 42/76] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:32 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:32.677432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:32.680938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:32.684664 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:32.694329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a0698718-9315-4c9b-896a-72e5fc76dcd8 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.230506 Sep 08 16:08:32.697757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:32.698746 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 35/77] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:32 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:32.699791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:32.700526 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.701482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:32.702316 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:32.703088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:32.875613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:32.887169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e31fb20c-4904-41d6-b27c-b3a1ff5f1f53 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.213829 Sep 08 16:08:32.897428 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 43/78] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:32 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:33.119951 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:33.120637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:33.126781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.127505 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.127940 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.128899 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.129061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.129754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.287201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:33.297011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:33.298840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:33.299738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0aad1eb3-534a-4509-a834-2d2297d1608e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.183799 Sep 08 16:08:33.300461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 36/79] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:33 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:33.630214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:33.631413 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:33.639297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.641186 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.642068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.642877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.643362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.643904 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.724167 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:33.725310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:33.733374 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.734748 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.735190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.736370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.737897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.738500 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.814589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:33.826714 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-62bee727-156b-42d0-84bf-b734879a6b6f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.200437 Sep 08 16:08:33.836894 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 44/80] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:33 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:33.894486 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:33.903120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ce888a7c-702f-4a99-b186-5536d12fe3a2 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.183077 Sep 08 16:08:33.903727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 37/81] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:33 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:33.910145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:33.910822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:33.917006 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.917594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.918078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:33.918825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:33.919394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:33.919898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:34.073227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:34.082727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f0c3b19f-dff7-495b-8e72-adfd9ea53ce0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.176373 Sep 08 16:08:34.083878 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 45/82] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:33 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:34.324978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:34.325569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:34.332068 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:34.332542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:34.333238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:34.333654 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:34.334135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:34.334739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:34.479161 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:34.497384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:34.497384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:34.497384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1cd1016e-3188-43e9-ab3a-3359dd512c58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.173150 Sep 08 16:08:34.497611 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 38/83] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:34 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:34.851187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:34.852765 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:34.863563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:34.864303 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:34.864838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:34.865843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:34.866470 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:34.867069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:34.929340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:34.930630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:34.940177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:34.941293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:34.942148 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:34.943484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:34.944128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:34.944729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:35.022723 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:35.033102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0074e833-e0af-43f4-92c2-82318206bd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.186951 Sep 08 16:08:35.033680 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 46/84] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:34 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:35.107411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:35.108063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:35.124966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:35.125535 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:35.126007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:35.126737 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:35.127262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:35.127772 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:35.305137 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:35.310891 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:35.313429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e50c2f1c-cbdd-44b2-8b58-26b9780a63b0 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.390892 Sep 08 16:08:35.327691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-be55bb5e-d39b-4874-a1a6-f332162191d9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.216901 Sep 08 16:08:35.327691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 47/85] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:35 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:35.328341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 39/86] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:34 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:35.523135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:35.525274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:35.535242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:35.536142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:35.537036 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:35.537974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:35.539548 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:35.540290 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:35.705841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:35.714970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:35.716558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:35.717725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3606abbc-8e47-47ba-9508-6cf281eb2fa1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.200199 Sep 08 16:08:35.719162 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 48/87] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:35 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:36.057722 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:36.059744 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:36.067128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-d1df8a6d-a94b-4afe-8433-c95f09e8a416 req-c9f246b3-01b8-4afb-a86d-1ad9f75a67c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:36.072438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.073138 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.074533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.076698 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.077133 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.078968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.093077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d1df8a6d-a94b-4afe-8433-c95f09e8a416 req-c9f246b3-01b8-4afb-a86d-1ad9f75a67c5 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.093569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d1df8a6d-a94b-4afe-8433-c95f09e8a416 req-c9f246b3-01b8-4afb-a86d-1ad9f75a67c5 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.095039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d1df8a6d-a94b-4afe-8433-c95f09e8a416 req-c9f246b3-01b8-4afb-a86d-1ad9f75a67c5 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.134954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-d1df8a6d-a94b-4afe-8433-c95f09e8a416 req-c9f246b3-01b8-4afb-a86d-1ad9f75a67c5 service nova] Creating event network-changed:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:08:36.151838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-d1df8a6d-a94b-4afe-8433-c95f09e8a416 req-c9f246b3-01b8-4afb-a86d-1ad9f75a67c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085562 Sep 08 16:08:36.153931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 49/88] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:36.276913 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:36.288891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2fe8c972-a180-4eb0-bb5c-bb5464568f74 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.235940 Sep 08 16:08:36.290080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 40/89] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:36 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:36.343647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:36.347025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:36.347799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:36.349722 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:36.357209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.362900 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.365013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.365562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.366079 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.366878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.367402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.368122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.368556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.370620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.372317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.373093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.560786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:36.563102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:36.571602 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3594315e-444d-4174-9ef1-683251a5ab31 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.230743 Sep 08 16:08:36.573123 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 41/90] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:36 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:36.573884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f4fb9ff2-e33f-49b9-b129-cc761832a24d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.239338 Sep 08 16:08:36.574464 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 50/91] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:36 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:36.744686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:36.745936 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:36.764833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.765353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.765828 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.767607 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:36.768062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:36.768477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:36.917089 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:36.925587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:36.927204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:36.928385 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-107a5940-8816-4240-8424-732c5efee224 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.187903 Sep 08 16:08:36.928953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 42/92] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:36 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:37.314851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:37.314851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:37.321278 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.322038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.322454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.323147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.323690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.324107 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.509029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:37.517185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6d09cd24-8f92-41db-b45d-a6f672673012 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.206787 Sep 08 16:08:37.518060 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 51/93] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:37 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:37.596002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:37.601720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:37.602269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:37.603792 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:37.613025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.613568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.615303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.615933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.616373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.617068 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.617521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.617938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.618594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.619553 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.620285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.621027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.784768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:37.794266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6281109e-2756-48c3-84d8-192d81a28dcf tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.196532 Sep 08 16:08:37.794864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 52/94] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:37 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:37.795369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:37.803316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-636807c0-7ac3-43df-aeff-22546c935e05 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.212909 Sep 08 16:08:37.804329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 43/95] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:37 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:37.954516 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:37.955132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:37.957123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:37.969677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.970176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.970607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:37.971323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:37.971791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:37.972213 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:38.118949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:38.129607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:38.131099 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:38.133154 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4105da59-b1b9-4472-9d4a-204adb9a3670 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.182405 Sep 08 16:08:38.134410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 53/96] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:37 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:38.540627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:38.541220 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:38.552911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:38.553435 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:38.553886 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:38.561177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:38.561664 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:38.562098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:38.817539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:38.818845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:38.831295 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:38.832137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:38.832731 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:38.833589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:38.834207 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:38.834769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:39.051374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:39.067219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b77e4a3a-b2a1-4fb2-8c41-0097f4380187 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.254043 Sep 08 16:08:39.068028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 54/97] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:38 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:39.077966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:39.078648 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:39.092270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:39.093222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:39.093666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:39.094383 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:39.094837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:39.100506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:39.394854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:39.414714 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f2e77b45-9f34-407e-9bd6-7e971b7e83e7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.345469 Sep 08 16:08:39.415279 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 55/98] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:39 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:39.429834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:39.431378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:39.439401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:39.440288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:39.441887 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:39.443868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:39.444467 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:39.445002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:39.758805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:39.774469 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-94c89fdd-ad37-457c-aafc-6e7bace75364 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 1.236465 Sep 08 16:08:39.775735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 44/99] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:38 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:39.815961 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:39.825179 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:39.829761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:39.833891 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2f5c20ae-5f85-4281-9dd6-1e71badb2f1e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.417617 Sep 08 16:08:39.836176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 56/100] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:39 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:40.090399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:40.091173 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:40.098488 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.101268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.101861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.102723 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.103315 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.103908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.271710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:40.281890 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b996777-4f4a-4f6c-be23-632be64d834e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.195544 Sep 08 16:08:40.282676 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 45/101] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:40 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:40.437931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:40.438850 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:40.464706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.465185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.465618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.466749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.467512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.468087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.709127 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:40.736816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bab9be21-2d04-4f31-a03e-1f0459496a0a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.303165 Sep 08 16:08:40.738629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 57/102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:40 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:40.800392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:40.801093 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:40.807891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.808644 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.809226 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.811378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.812127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.812771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.872159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:40.873404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:40.881134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.881787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.882395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.883097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:40.883581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:40.884029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:40.975522 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:41.039761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:41.048760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:41.050354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:41.051617 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f3641dc3-663e-4092-8558-8afd89da172c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.186031 Sep 08 16:08:41.052300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 58/103] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:40 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:41.120673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-7806fcef-e3df-4678-ac13-51da2dff51bf req-7962f0b3-ea4c-45b7-ba20-5441f27c81b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcc5ea9-0755-493f-9c67-4a0d0076df04", "name": "network-vif-plugged", "status": "completed", "tag": "069de4c6-aa5c-4db6-aed3-8e98f197a113"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:41.132611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-7806fcef-e3df-4678-ac13-51da2dff51bf req-7962f0b3-ea4c-45b7-ba20-5441f27c81b9 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:41.133049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-7806fcef-e3df-4678-ac13-51da2dff51bf req-7962f0b3-ea4c-45b7-ba20-5441f27c81b9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:41.133472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-7806fcef-e3df-4678-ac13-51da2dff51bf req-7962f0b3-ea4c-45b7-ba20-5441f27c81b9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:41.145727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-7806fcef-e3df-4678-ac13-51da2dff51bf req-7962f0b3-ea4c-45b7-ba20-5441f27c81b9 service nova] Creating event network-vif-plugged:069de4c6-aa5c-4db6-aed3-8e98f197a113 for instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 on hv-cinder-85625 Sep 08 16:08:41.151148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-7806fcef-e3df-4678-ac13-51da2dff51bf req-7962f0b3-ea4c-45b7-ba20-5441f27c81b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097673 Sep 08 16:08:41.151791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 59/104] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:41.276741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:41.287038 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dfedd78e-e5d0-4860-a9e1-0bffb3a7ceb7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.491096 Sep 08 16:08:41.287774 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 46/105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:40 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:41.318148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:41.319654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:41.327647 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:41.328340 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:41.329353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:41.331795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:41.335604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:41.340033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:41.362762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:41.495359 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:41.504643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3219a780-475d-4b4f-9886-67901d3fbd71 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.193228 Sep 08 16:08:41.505255 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 60/106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:41 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:41.763761 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:41.764811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:41.774222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:41.775300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:41.776114 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:41.777327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:41.778102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:41.778738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:41.839809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:42.082628 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:42.083421 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:42.094007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:42.114089 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5c34a1cd-3527-44f2-8d91-7ae163f6bf1f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.354577 Sep 08 16:08:42.116108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:42.116602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:42.117032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:42.117735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:42.118184 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:42.118613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:42.120469 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 47/107] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:41 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:42.312040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:42.312954 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:42.323802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:42.325409 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:42.326391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:42.327459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:42.328316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:42.328997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:42.371384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:42.380872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:42.382322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:42.387039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-99cd98a0-88db-4bdc-a3c6-6dba0b01d0b7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.311312 Sep 08 16:08:42.391738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 61/108] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:42 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:08:42.524381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:42.528315 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:42.529295 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:42.533319 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-29fd8769-0072-41cf-9bb2-70ea65d04b38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.226063 Sep 08 16:08:42.535030 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 48/109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:42 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:42.538661 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:42.539313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:42.540394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:42.541619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:42.542480 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:42.543038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:42.713758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:42.722285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5dd0685e-f8d1-4e3c-9733-dd60841728ef tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.199073 Sep 08 16:08:42.722872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 62/110] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:42 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:43.141260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:43.141869 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:43.147823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.148305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.148734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.149601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.150057 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.150799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.167778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-62e1f1f4-f1d1-4e40-b277-4277b3482af4 req-8e4d956f-fb15-4f3e-8ee1-0cfe5f594923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43cfdfd-dab3-4549-8e16-09873ba10625", "name": "network-vif-plugged", "status": "completed", "tag": "28d10c4d-3c67-4071-92ee-9fcbdcbec9af"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:43.192633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-62e1f1f4-f1d1-4e40-b277-4277b3482af4 req-8e4d956f-fb15-4f3e-8ee1-0cfe5f594923 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.193167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-62e1f1f4-f1d1-4e40-b277-4277b3482af4 req-8e4d956f-fb15-4f3e-8ee1-0cfe5f594923 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.193807 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-62e1f1f4-f1d1-4e40-b277-4277b3482af4 req-8e4d956f-fb15-4f3e-8ee1-0cfe5f594923 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.211753 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-62e1f1f4-f1d1-4e40-b277-4277b3482af4 req-8e4d956f-fb15-4f3e-8ee1-0cfe5f594923 service nova] Creating event network-vif-plugged:28d10c4d-3c67-4071-92ee-9fcbdcbec9af for instance e43cfdfd-dab3-4549-8e16-09873ba10625 on hv-cinder-85625 Sep 08 16:08:43.219046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-62e1f1f4-f1d1-4e40-b277-4277b3482af4 req-8e4d956f-fb15-4f3e-8ee1-0cfe5f594923 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056831 Sep 08 16:08:43.219769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 63/111] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:08:43.332217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:43.341170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7280bbaf-f417-44cb-b15a-9c2e499e79c5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.203762 Sep 08 16:08:43.342158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 49/112] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:43 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:43.418169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:43.420329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:43.428770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.429438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.429864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.430853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.431479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.432208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.557181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:43.557889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:43.571272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.573738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.574280 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.575245 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.576690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.577244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.673073 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:43.683368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:43.688693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:43.689841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9c966b3c-1b30-4dc0-a444-09d70bd053a2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.278599 Sep 08 16:08:43.691529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 64/113] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:43 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:43.747388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:43.748023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:43.755750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.756239 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.760796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.761685 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:43.762155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:43.762587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:43.811580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:43.820446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2bfd2321-9f0a-4456-a56a-b6b2468e955e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.267036 Sep 08 16:08:43.823498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 50/114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:43 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:43.950436 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:43.962750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f8d55e12-afa2-4691-9b93-e98371de0365 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.216959 Sep 08 16:08:43.962750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 65/115] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:43 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:44.365880 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:44.366466 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:44.373695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.374407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:44.374863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:44.375998 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.376465 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:44.377041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:44.720362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:44.720944 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:44.729443 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.729901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:44.730359 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:44.731053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.731487 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:44.732084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:44.828360 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:44.845080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eec5cbfa-bdd2-467a-b0b1-b8dd47fa9541 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.483339 Sep 08 16:08:44.851510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 51/116] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:44 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:44.856811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:44.857833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:44.864649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.865350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:44.865918 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:44.866764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.867371 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:44.867962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:44.935110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:44.944503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:44.949264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:44.950608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9f94cf12-847f-41d6-9b00-ad6079a0d70f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.234189 Sep 08 16:08:44.954085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 66/117] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:44 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:08:44.985994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:44.986604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:44.996425 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:44.996912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:45.000147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:45.001509 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:45.004513 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:45.005230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:45.086848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:45.098754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a3c5ecf7-9930-49ef-af52-a0a4eb98b102 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.245797 Sep 08 16:08:45.100289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 52/118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:44 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:45.202190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:45.214386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f2cd690d-7414-4158-8fd6-a98a9fbf0c5e tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.232445 Sep 08 16:08:45.215674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 67/119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:44 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:45.868726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:45.869281 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:45.875861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:45.876491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:45.876859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:45.877603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:45.878050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:45.878459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:45.981447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:45.982427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:45.988901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:45.989479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:45.989980 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:45.990754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:45.991274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:45.991946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:46.037462 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:46.047638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0c74f94b-d282-44ce-ad6e-52037a693049 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.182796 Sep 08 16:08:46.048766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 53/120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:45 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:46.129016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:46.130474 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:46.140556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:46.142660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:46.143301 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:46.144512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:46.145378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:46.146579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:46.147563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:46.157112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:46.158878 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:46.160262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-55c7fa6f-8df0-4c5a-8838-d694a65b9a7b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.184362 Sep 08 16:08:46.171466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 68/121] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:45 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:46.240996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:46.241751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:46.253525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:46.254387 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:46.255027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:46.257328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:46.257935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:46.258488 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:46.355834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:46.365376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-deb1bd85-cc85-42ca-babe-b312481311ac tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.243055 Sep 08 16:08:46.366115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 54/122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:46 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:46.427087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:46.437121 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3356d2df-5bf0-4e34-92ee-aa0a8fcd3bf4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.202318 Sep 08 16:08:46.437813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 69/123] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:46 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:46.966595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1186055533", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "networks": [{"uuid": "3f06a316-8f64-4b9b-9a27-1af9727d7cc9"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:47.027603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] validate_networks() for [('3f06a316-8f64-4b9b-9a27-1af9727d7cc9', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:08:47.072016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:47.072693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:47.080017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.080017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.080017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.080358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.080984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.081404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.215989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.223840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f2d5ab44-ce40-4ddb-b263-04ded524d08b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.156067 Sep 08 16:08:47.224422 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 70/124] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:47 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:47.228871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:47.229742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:47.235597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.236086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.236518 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.237209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.237662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.238082 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.369316 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.377726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.379333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.380584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5c3cadc8-9087-4762-83de-e0c77ebe1ea0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.155177 Sep 08 16:08:47.381117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 71/125] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:47 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:47.387919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:47.388721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:47.394687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.395288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.395851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.396955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.397496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.397984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.401327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:08:47.401744 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:08:47.402216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:08:47.402619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:08:47.403019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:08:47.412493 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.412968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.413402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.414115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.414562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.414975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.431414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Getting quotas for project bafdc72abf95401f8784411bc8e55822. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:08:47.435378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Getting quotas for user 2127487c50884141b2776f05e96471fd and project bafdc72abf95401f8784411bc8e55822. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:08:47.446725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:08:47.449381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:08:47.498213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-28141d5d-5739-4677-a3a7-e1ce52cb8dc2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535612 Sep 08 16:08:47.499067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 55/126] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:08:47.508955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:47.509646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:47.516144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.516630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.517063 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.517753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:47.518206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:47.518622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:47.537026 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.544710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-113ecaae-9015-43d5-8d8d-4e75b0cdf23d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.160419 Sep 08 16:08:47.550696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 72/127] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:47 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:47.554427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d182c87a-5ac9-4246-a551-8fee3f07b377 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:47.562979 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d182c87a-5ac9-4246-a551-8fee3f07b377 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:47.617784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d182c87a-5ac9-4246-a551-8fee3f07b377 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.625251 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d182c87a-5ac9-4246-a551-8fee3f07b377 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1219 microversion: 2.1 time: 0.078670 Sep 08 16:08:47.625828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 73/128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:47 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:47.662227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:47.670017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0f62f823-f2aa-4e75-885c-16c38c73cec6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.170218 Sep 08 16:08:47.670583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 56/129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:47 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:48.246734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:48.247342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:48.253923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.254410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.254852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.255588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.256042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.256466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.385487 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.393347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d007894a-0f2a-4871-b387-cbe6f207817d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.150647 Sep 08 16:08:48.393918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 74/130] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:48 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:48.405932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:48.406530 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:48.412485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.412953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.413373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.414042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.414482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.414891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.542569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.550796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.552652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.553759 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-aa398d3a-498d-475b-9ff8-44ddb528085f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.151748 Sep 08 16:08:48.554297 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 57/131] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:48 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:08:48.568241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:48.568854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:48.576019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.576493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.576921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.577626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.578063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.578484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.651908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:48.652516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:48.661651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.665529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.666228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.667009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.667436 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.667853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.719504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.730362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5883b27-a0e1-4d5e-b980-2c8bfe1a8d5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.165941 Sep 08 16:08:48.730948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 75/132] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:48 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:48.735485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:48.736155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:48.741961 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.742615 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.742987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.743410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.744158 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:48.744603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:48.745179 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:48.750924 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-146ee14b-f454-45d8-b5a7-851e4bba8b12 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1223 microversion: 2.1 time: 0.106276 Sep 08 16:08:48.751564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 58/133] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:48 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:48.874889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:48.886324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aa5f4133-9a69-4cfe-b46a-1d954c35a29d tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.154155 Sep 08 16:08:48.887232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 76/134] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:48 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:49.419143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:49.420017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:49.429353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.430388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.431030 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.432617 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.434080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.434675 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.579069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:49.579791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:49.586310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.587360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.588000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.588764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.589368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.590313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.594644 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:49.603789 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ffb4e876-f929-4d70-8d85-efe4c49a9411 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.191276 Sep 08 16:08:49.604418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 59/135] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:49 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:49.609164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0b122c7f-9021-484c-b6d4-8cadaac57607 req-fc32b63d-fb53-4dca-acf1-6c4ecf94354e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d36039-930c-4f96-93c3-c9fb893ae77c", "name": "network-vif-plugged", "status": "completed", "tag": "4478aeb3-30cc-4a4e-9707-bb149198bb14"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:49.618765 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0b122c7f-9021-484c-b6d4-8cadaac57607 req-fc32b63d-fb53-4dca-acf1-6c4ecf94354e service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.619419 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0b122c7f-9021-484c-b6d4-8cadaac57607 req-fc32b63d-fb53-4dca-acf1-6c4ecf94354e service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.620200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0b122c7f-9021-484c-b6d4-8cadaac57607 req-fc32b63d-fb53-4dca-acf1-6c4ecf94354e service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.635990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0b122c7f-9021-484c-b6d4-8cadaac57607 req-fc32b63d-fb53-4dca-acf1-6c4ecf94354e service nova] Creating event network-vif-plugged:4478aeb3-30cc-4a4e-9707-bb149198bb14 for instance 85d36039-930c-4f96-93c3-c9fb893ae77c on hv-cinder-85625 Sep 08 16:08:49.644884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0b122c7f-9021-484c-b6d4-8cadaac57607 req-fc32b63d-fb53-4dca-acf1-6c4ecf94354e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037985 Sep 08 16:08:49.646035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 60/136] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:49.754610 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:49.755566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:49.766471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.773632 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.774353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.775303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.784296 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.784749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:49.809320 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:49.811847 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:49.814612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3e4e7dbd-53e0-4b0c-85de-7c23bf795716 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.239821 Sep 08 16:08:49.815842 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 77/137] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:49 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:08:49.828880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:49.830783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:49.839494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.840568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.841642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.842367 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.842972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.843396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.924913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:49.929650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:49.937119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bf5f2b84-ce5b-4a6d-90d8-76f916ee6ccb tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1271 microversion: 2.1 time: 0.119336 Sep 08 16:08:49.953248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 78/138] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:49 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:49.953248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:49.953248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:49.953248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.953738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.953738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:49.954954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:49.955768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:49.956433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:50.062379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:50.083696 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0717e5b2-f06a-4986-9450-c6d3d6a3d473 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.321115 Sep 08 16:08:50.083696 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 61/139] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:49 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:50.177928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:50.187108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-60172d7e-a83b-452c-a8a5-d6f74f6ea697 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1314 microversion: 2.1 time: 0.247754 Sep 08 16:08:50.188081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 79/140] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:49 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:50.628663 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:50.629279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:50.635304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:50.635818 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:50.636237 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:50.636916 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:50.637358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:50.637767 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:50.778279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:50.786743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-75e0070c-c433-4a24-bc33-65ed8d2d4114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.162623 Sep 08 16:08:50.787421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 62/141] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:50 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:50.844907 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:50.845517 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:50.851755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:50.852231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:50.852642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:50.853316 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:50.853755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:50.854211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:50.960909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:50.961516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:50.967549 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:50.968032 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:50.968463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:50.969146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:50.969597 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:50.970016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.008992 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:51.017384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:51.018814 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:51.019945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8236ed65-de75-4d47-bffd-e6aef211052b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.179003 Sep 08 16:08:51.020507 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 80/142] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:50 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:08:51.034955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:51.042717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-775dec24-46b6-454d-93d5-cac2ba6d8a98 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1271 microversion: 2.1 time: 0.085689 Sep 08 16:08:51.043301 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 63/143] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:50 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:51.094467 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:51.094881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:51.101428 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.102071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.102435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.103123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.103619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.104040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.212976 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:51.213628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:51.220460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.221467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.221932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.222753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.223197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.223967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.243885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:51.253103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7924b2d7-50a4-4a3f-9448-a2b3fde826d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.163007 Sep 08 16:08:51.253901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 81/144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:51 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:51.363366 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:51.371249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f5036f53-b5f3-4c4b-a077-6b6f6b009870 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1501 microversion: 2.1 time: 0.163730 Sep 08 16:08:51.371862 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 64/145] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:51 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:51.699698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387edd6e-7535-44c5-b75d-4a17415dd41c", "name": "network-vif-plugged", "status": "completed", "tag": "16a74b42-c0f4-435a-b6b7-c1c2856418c8"}, {"server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "name": "network-vif-plugged", "status": "completed", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:51.713712 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.714581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.715847 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.734918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] Creating event network-vif-plugged:16a74b42-c0f4-435a-b6b7-c1c2856418c8 for instance 387edd6e-7535-44c5-b75d-4a17415dd41c on hv-cinder-85625 Sep 08 16:08:51.735454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] Creating event network-vif-plugged:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:08:51.744347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-ac5fa89c-786f-4db4-9fa3-f7087827bce7 req-80b3dbda-95bf-4f22-b2ec-1cd8289a5f8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049370 Sep 08 16:08:51.745686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 82/146] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:51.815182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:51.816692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:51.825614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.826324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.826968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.827991 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:51.828702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:51.829376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:51.854496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:52.048026 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:52.048774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:52.055769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:52.056254 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:52.056809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:52.057743 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:52.058261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:52.058678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:52.117700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:52.126520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7d60f03a-628b-4221-bb17-bc1e592ddd42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1366 microversion: 2.1 time: 0.321160 Sep 08 16:08:52.127354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 65/147] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:51 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:52.149766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:52.150518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:52.156636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:52.157468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:52.164062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:52.166412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:52.168106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:52.168680 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:52.247137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:52.257349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:52.261531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:52.272113 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:52.273755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8dd7e548-8593-45c4-bb08-469837bde111 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.230186 Sep 08 16:08:52.274432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 83/148] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:52 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:08:52.281459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:52.282213 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:52.291246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8400ece1-2f40-48f7-a5ef-2b9969661e5e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1279 microversion: 2.1 time: 0.162073 Sep 08 16:08:52.301449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:52.302226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:52.304169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:52.304320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 66/149] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:52 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:52.306507 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:52.306989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:52.307468 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:52.550972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:52.564855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-096c2796-c571-4dbb-b2d1-e85cbe30fc38 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.288196 Sep 08 16:08:52.565472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 84/150] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:52 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:53.049977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59d0420f-e1b6-4341-ab0d-3bfdb247cbd2"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:53.053073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:53.059583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.060280 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.060884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.061743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.062340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.062910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.153554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:53.154159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:53.175917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.176417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.176846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.177553 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.178001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.178416 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.420694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:53.431640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-96f46fdf-f0a4-4cdc-9033-fabf92fe27be tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1556 microversion: 2.1 time: 0.280919 Sep 08 16:08:53.432178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 85/151] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:53 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1556 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:53.437206 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:53.437859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:53.444361 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.444836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.445264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.446510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.447111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.447742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.615112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:53.630654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:53.633182 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:53.639317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5851a277-beef-4f1f-a2eb-ac0e7a1ce3d7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1406 microversion: 2.20 time: 0.205369 Sep 08 16:08:53.640568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 86/152] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:53 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:53.645918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:53.646890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:53.654253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.655229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.655912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.658491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.659217 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.660136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.942200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:53.952175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-279742b6-8204-4843-92d5-1e4001324dc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.309902 Sep 08 16:08:53.952737 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 87/153] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:53 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:53.958925 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:53.959421 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:53.965014 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:53.967050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.967569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.968085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:53.969454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:53.969943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:53.970460 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:54.118459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d62d1f48-a40e-4e54-b77d-3ac30ea2b850 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164543 Sep 08 16:08:54.119064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 88/154] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:08:53 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:54.124898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:54.126290 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:54.138753 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:54.139492 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:54.140185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:54.141512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:54.142324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:54.143005 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:54.615929 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:54.629866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9b066089-94de-41c0-ad35-133483ed142d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1322 microversion: 2.1 time: 0.509373 Sep 08 16:08:54.632025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 89/155] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:54 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:54.667576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:54.668533 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:54.678804 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:54.680176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:54.680940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:54.682201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:54.683015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:54.683771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.030401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:55.040281 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:55.042175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:55.043589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1fb4b4cb-224d-49e7-9641-a65c053023b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1598 microversion: 2.20 time: 0.380987 Sep 08 16:08:55.055945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 90/156] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:08:54 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1598 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:08:55.071616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:55.073828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:55.087855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.088462 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.090912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.092108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.096037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.096448 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-11d28f23-fc57-4586-b572-1560bc9d1b04 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "POST /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.050244 Sep 08 16:08:55.097121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 67/157] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:08:53 2022] POST /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625/os-volume_attachments => generated 194 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:55.097371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.111700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:55.112396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:55.126055 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.126586 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.127022 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.127755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.128209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.128633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.302643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-916d0764-68bf-4560-950f-7cbb76687cb0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.204154 Sep 08 16:08:55.303754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 68/158] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 16:08:55 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:08:55.353948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-6fc0a186-9207-4695-9fc9-9ec8a487778b req-bed8770c-7c5e-4ab7-86f0-385f0b6ca6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c63cd6d-611a-46da-a40f-cc3360c0c0a9", "tag": "f1e819b2-5c8d-4007-bb6f-892f5b55da8c"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:55.370710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6fc0a186-9207-4695-9fc9-9ec8a487778b req-bed8770c-7c5e-4ab7-86f0-385f0b6ca6bd service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.371547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6fc0a186-9207-4695-9fc9-9ec8a487778b req-bed8770c-7c5e-4ab7-86f0-385f0b6ca6bd service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.372262 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6fc0a186-9207-4695-9fc9-9ec8a487778b req-bed8770c-7c5e-4ab7-86f0-385f0b6ca6bd service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.385855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-6fc0a186-9207-4695-9fc9-9ec8a487778b req-bed8770c-7c5e-4ab7-86f0-385f0b6ca6bd service nova] Creating event network-changed:f1e819b2-5c8d-4007-bb6f-892f5b55da8c for instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 on hv-cinder-85625 Sep 08 16:08:55.391319 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-6fc0a186-9207-4695-9fc9-9ec8a487778b req-bed8770c-7c5e-4ab7-86f0-385f0b6ca6bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041096 Sep 08 16:08:55.392848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 69/159] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:55.632003 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:55.653275 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f1e58887-f90c-43a4-a231-3c6354b57d3c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.593587 Sep 08 16:08:55.661634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:55.662596 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:55.695905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 91/160] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:55 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:55.699825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.700587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.701215 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:55.702111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:55.702752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:55.703360 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:56.010312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:56.019541 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-117a731e-b5b2-429e-bec8-eb0f2fadef5a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1514 microversion: 2.1 time: 0.363354 Sep 08 16:08:56.023385 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 70/161] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:55 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:08:56.052075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:56.055482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:56.071227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:56.072112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:56.073256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:56.074865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:56.076524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:56.078791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:56.131999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'flavor' on Instance uuid 387edd6e-7535-44c5-b75d-4a17415dd41c {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:08:56.362319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5ef89b80-0c4e-4337-a513-cb431ba2d391 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c/action" status: 200 len: 32 microversion: 2.1 time: 0.315295 Sep 08 16:08:56.367728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 92/162] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:08:56 2022] POST /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:08:56.378714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:56.378714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:56.388786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:56.389285 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:56.390583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:56.390583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:56.390852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:56.393131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:56.698009 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:56.699505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:56.721265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:56.723228 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:56.725529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:56.729176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:56.730371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:56.732559 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:57.095137 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:57.117035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-13d3ba0b-b9e8-45e7-903b-bf0bcc671382 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.742579 Sep 08 16:08:57.124761 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 71/163] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:56 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:57.304002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:57.316375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b544a85f-bdf2-4e39-94a1-7a198716e085 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.628305 Sep 08 16:08:57.318125 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 93/164] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:56 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:57.455856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-fdc41f83-d613-400e-a0c4-c2eaf4b4ea42 req-9d5e9a19-a883-40ea-8e13-af9403e5f50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d36039-930c-4f96-93c3-c9fb893ae77c", "tag": "4478aeb3-30cc-4a4e-9707-bb149198bb14"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:57.465058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:57.470644 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:57.473807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:57.495027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fdc41f83-d613-400e-a0c4-c2eaf4b4ea42 req-9d5e9a19-a883-40ea-8e13-af9403e5f50a service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:57.495848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fdc41f83-d613-400e-a0c4-c2eaf4b4ea42 req-9d5e9a19-a883-40ea-8e13-af9403e5f50a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:57.496897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-fdc41f83-d613-400e-a0c4-c2eaf4b4ea42 req-9d5e9a19-a883-40ea-8e13-af9403e5f50a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:57.525462 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-fdc41f83-d613-400e-a0c4-c2eaf4b4ea42 req-9d5e9a19-a883-40ea-8e13-af9403e5f50a service nova] Creating event network-changed:4478aeb3-30cc-4a4e-9707-bb149198bb14 for instance 85d36039-930c-4f96-93c3-c9fb893ae77c on hv-cinder-85625 Sep 08 16:08:57.539358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-fdc41f83-d613-400e-a0c4-c2eaf4b4ea42 req-9d5e9a19-a883-40ea-8e13-af9403e5f50a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087953 Sep 08 16:08:57.547046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 72/165] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:08:58.153844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:58.153844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:58.156411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:58.170217 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:58.170725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:58.171161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:58.176127 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:58.176454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:58.176890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:58.218493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:08:58.341342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:58.342038 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:58.353131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:58.353922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:58.354528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:58.355565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:58.356167 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:58.357184 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:58.428338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:58.448683 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6914dd16-1c4f-450b-90e8-3b85dbbf8067 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.302402 Sep 08 16:08:58.449652 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 94/166] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:58 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:58.617502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:58.628479 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-356eb6bf-b714-401a-bb06-e123cd386108 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.291177 Sep 08 16:08:58.632094 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 73/167] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:58 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:59.476005 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.476827 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:59.483342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:59.487192 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:59.488876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:59.489954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:59.492790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:59.493337 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:59.600076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-039d52c2-5eee-49b4-8471-f145b7d537bf req-21825ede-d31e-40d8-8651-82092c5cf46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:08:59.610860 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-039d52c2-5eee-49b4-8471-f145b7d537bf req-21825ede-d31e-40d8-8651-82092c5cf46d service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:59.611600 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-039d52c2-5eee-49b4-8471-f145b7d537bf req-21825ede-d31e-40d8-8651-82092c5cf46d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:59.612202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-039d52c2-5eee-49b4-8471-f145b7d537bf req-21825ede-d31e-40d8-8651-82092c5cf46d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:59.624447 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-039d52c2-5eee-49b4-8471-f145b7d537bf req-21825ede-d31e-40d8-8651-82092c5cf46d service nova] Creating event network-changed:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:08:59.629357 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-039d52c2-5eee-49b4-8471-f145b7d537bf req-21825ede-d31e-40d8-8651-82092c5cf46d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Sep 08 16:08:59.630151 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 74/168] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:08:59.654610 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:08:59.655304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:08:59.674898 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:59.675623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:59.682507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:59.683497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:08:59.684105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:08:59.684792 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:08:59.690833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:59.700290 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cacdccb8-106d-474b-a251-56b947622dbe tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.228523 Sep 08 16:08:59.700873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 95/169] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:59 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:08:59.985211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:08:59.999106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-11f07217-4be0-4617-8735-8098c6db825a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.350397 Sep 08 16:09:00.000098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 75/170] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:08:59 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:00.723782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:00.724319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:00.730599 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:00.731086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:00.733871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:00.735080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:00.735688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:00.736258 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:00.887924 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:00.895705 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8019492e-5d08-41e8-81e0-b76bfe179f2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.175924 Sep 08 16:09:00.896301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 96/171] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:00 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:01.033691 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.033691 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:01.033691 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:01.033691 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:01.034359 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:01.034359 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:01.034359 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:01.034781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:01.164040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:01.171981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-590d7e0a-e2e5-4d9a-8c55-dc6356456279 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.150989 Sep 08 16:09:01.172554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 76/172] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:01 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:01.495762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-9f37f7a7-0341-4d89-ac12-991f17301fb3 req-a98c194e-3a36-4a62-9568-9dab09f1e522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63cd6d-611a-46da-a40f-cc3360c0c0a9", "name": "network-vif-plugged", "status": "completed", "tag": "f1e819b2-5c8d-4007-bb6f-892f5b55da8c"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:01.506618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9f37f7a7-0341-4d89-ac12-991f17301fb3 req-a98c194e-3a36-4a62-9568-9dab09f1e522 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:01.507077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9f37f7a7-0341-4d89-ac12-991f17301fb3 req-a98c194e-3a36-4a62-9568-9dab09f1e522 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:01.507546 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-9f37f7a7-0341-4d89-ac12-991f17301fb3 req-a98c194e-3a36-4a62-9568-9dab09f1e522 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:01.520598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-9f37f7a7-0341-4d89-ac12-991f17301fb3 req-a98c194e-3a36-4a62-9568-9dab09f1e522 service nova] Creating event network-vif-plugged:f1e819b2-5c8d-4007-bb6f-892f5b55da8c for instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 on hv-cinder-85625 Sep 08 16:09:01.526771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-9f37f7a7-0341-4d89-ac12-991f17301fb3 req-a98c194e-3a36-4a62-9568-9dab09f1e522 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035025 Sep 08 16:09:01.527385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 97/173] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:01.918664 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:01.919372 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:01.925620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:01.926109 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:01.926538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:01.927224 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:01.928025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:01.928168 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:02.062996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:02.071075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6a913671-1ef9-4d9c-a51c-b10b4e365fbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.156538 Sep 08 16:09:02.071685 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 77/174] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:01 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:02.194790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:02.195889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:02.202368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:02.203044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:02.203705 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:02.204396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:02.204845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:02.205254 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:02.351155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:02.359134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-41657304-c632-492e-87a3-c3f81e8a4d9b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.168604 Sep 08 16:09:02.359815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 98/175] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:02 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:03.094568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.095278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:03.101919 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:03.102395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:03.102820 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:03.103625 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:03.104108 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:03.104522 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:03.355956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:03.365724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a53ad454-d11a-42ca-b4f0-65ef81a43e4f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.275253 Sep 08 16:09:03.367556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 78/176] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:03 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:03.382882 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:03.384256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:03.391650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:03.392190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:03.392624 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:03.393326 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:03.393781 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:03.394201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:03.528735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:03.536898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1d33acbd-24be-46e2-9bd7-19e4d2c9be4a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.158686 Sep 08 16:09:03.537489 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 99/177] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:03 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:04.324075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:04.324703 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:04.330825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.331293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.331744 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.332418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.332857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.333265 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.359322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:09:04.388138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:04.388712 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:04.395378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.396122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.396439 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.397143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.397735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.398160 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.481945 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6efbdff6-7186-4b39-bdad-502019832fc9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 204 len: 0 microversion: 2.1 time: 0.161584 Sep 08 16:09:04.486824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 79/178] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:09:04 2022] DELETE /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:09:04.493544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:04.494548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:04.502480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.503127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.503947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.504796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.505447 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.506008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.582310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:04.593365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-77d08750-4fcd-4277-9f4c-ff6efd4e9a32 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.208548 Sep 08 16:09:04.594554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 100/179] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:04 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:04.600883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:04.602469 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:04.612039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.612744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.613176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.613885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:04.614332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:04.614782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:04.698781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:04.708389 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3cfa4d67-f5b6-4d5f-801d-21e4c2b710a9 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1553 microversion: 2.1 time: 0.219800 Sep 08 16:09:04.709320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 80/180] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:04 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:04.773484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:04.781235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9054a9ee-f5ee-4a88-8f96-80c6cbacf35d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.185457 Sep 08 16:09:04.781809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 101/181] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:04 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:05.617301 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:05.617897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:05.627192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:05.627835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:05.628337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:05.629361 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:05.629913 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:05.630388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:05.649854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:05.741168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:05.742426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:05.751511 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:05.758950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:05.759394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:05.760189 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:05.760890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:05.762086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:05.823758 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:05.845537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6a71b325-e84c-4871-9f20-6c40bfb5f307 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.231373 Sep 08 16:09:05.846339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 81/182] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:05 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:05.857542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:05.858366 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:05.865785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:05.866275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:05.866707 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:05.867475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:05.868335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:05.868809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:05.912293 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:05.922121 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7f8ee796-89c7-4346-94d2-1040bf1f67c4 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1553 microversion: 2.1 time: 0.192836 Sep 08 16:09:05.923642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 102/183] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:05 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:06.033052 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:06.042188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e0173689-c8bd-4290-afc3-786ccfd82120 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1319 microversion: 2.1 time: 0.194523 Sep 08 16:09:06.042955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 82/184] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:05 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:06.868920 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:06.869645 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:06.876132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:06.876632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:06.877057 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:06.878068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:06.878670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:06.879113 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:06.952727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:06.954557 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:06.968000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:06.969591 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:06.970429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:06.971520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:06.972338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:06.973238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:07.028413 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:07.037257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa6dd586-7c9d-4c7c-8ce8-c9be9382fb65 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.171737 Sep 08 16:09:07.037853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 103/185] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:06 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:07.067609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:07.068237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:07.076897 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:07.077392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:07.077823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:07.078530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:07.078986 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:07.079412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:07.139938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:07.149570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e1f6b340-c855-4a58-a106-58f98d6b5770 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1553 microversion: 2.1 time: 0.205343 Sep 08 16:09:07.150752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 83/186] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:06 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:07.249718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:07.258105 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-baf51e32-3155-4f45-9370-ddb82cf29c72 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.196527 Sep 08 16:09:07.259431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 104/187] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:07 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:08.060427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:08.061697 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:08.069061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:08.069553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:08.070445 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:08.071361 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:08.071987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:08.072729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:08.179584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:08.180815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:08.189294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:08.189670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:08.190075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:08.191007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:08.191468 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:08.191885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:08.335809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:08.347694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:08.350782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-474aeb24-09ae-45ec-9746-e0b1f92ef7ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.294187 Sep 08 16:09:08.351698 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 84/188] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:08 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:08.359268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-36e5a55d-36a3-4b9b-8d88-ff21482415d6 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1553 microversion: 2.1 time: 0.184716 Sep 08 16:09:08.359972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 105/189] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:08 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:08.621190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-54ea8d25-fa8f-4d08-8346-6a35751fe1a2 req-a022b1a4-a327-4924-b6e0-6ff504eab995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e43cfdfd-dab3-4549-8e16-09873ba10625", "name": "network-vif-deleted", "tag": "28d10c4d-3c67-4071-92ee-9fcbdcbec9af"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:08.637214 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-54ea8d25-fa8f-4d08-8346-6a35751fe1a2 req-a022b1a4-a327-4924-b6e0-6ff504eab995 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:08.637793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-54ea8d25-fa8f-4d08-8346-6a35751fe1a2 req-a022b1a4-a327-4924-b6e0-6ff504eab995 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:08.639815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-54ea8d25-fa8f-4d08-8346-6a35751fe1a2 req-a022b1a4-a327-4924-b6e0-6ff504eab995 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:08.656130 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-54ea8d25-fa8f-4d08-8346-6a35751fe1a2 req-a022b1a4-a327-4924-b6e0-6ff504eab995 service nova] Creating event network-vif-deleted:28d10c4d-3c67-4071-92ee-9fcbdcbec9af for instance e43cfdfd-dab3-4549-8e16-09873ba10625 on hv-cinder-85625 Sep 08 16:09:08.663777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-54ea8d25-fa8f-4d08-8346-6a35751fe1a2 req-a022b1a4-a327-4924-b6e0-6ff504eab995 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048424 Sep 08 16:09:08.664551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 85/190] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:09.375764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:09.376482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:09.382687 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:09.383611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:09.384362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:09.384978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:09.386228 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:09.386546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:09.387198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:09.388017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:09.397852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:09.403969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:09.405270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:09.406389 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:09.407064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:09.407749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:09.462929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:09.463466 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:09.464306 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:09.465140 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lazy-loading 'fault' on Instance uuid e43cfdfd-dab3-4549-8e16-09873ba10625 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:09:09.526990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675b1a5759844cdaa7e0bf071a3ee030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0b2aab8dbf41a7a3c590ca61f022f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:09.535962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-036e81cf-65f6-4093-8303-7e4797878261 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 200 len: 1350 microversion: 2.1 time: 0.157539 Sep 08 16:09:09.536915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 86/191] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:09 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:09.559388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:09.568220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c675f4ed-3e5c-4b21-85ab-2e4195db78f1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.198112 Sep 08 16:09:09.568874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 106/192] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:09 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:10.559851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:10.560662 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:10.567876 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:10.568365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:10.568793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:10.569476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:10.569948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:10.570958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:10.586627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] HTTP exception thrown: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Request method failure captured: Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 HTTP/1.1 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNiXDrZy2i8rASsWz0ZqpRob8G5SL36syax1duR1lEiR182zE9NRl4wGp7Xk0aPmL_hFFw2E_lx2pKyCUKPMOLTJa-GuH1FZ02rX_I6CJY97PKtMgx_tlrZlpHmTx7YOk0MVEbTYTErKZqgTlhTHjTicKuopAkjKTLqn9XR1qAdWH8 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:09:10.591483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be0b2aab8dbf41a7a3c590ca61f022f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}] Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 675b1a5759844cdaa7e0bf071a3ee030 Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.593025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'e43cfdfd-dab3-4549-8e16-09873ba10625'} Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:09:10.594067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.595427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.596429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Returning 404 to user: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:09:10.596429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d3e8c7e9-2024-4d88-819e-4bcff8d135db tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 404 len: 111 microversion: 2.1 time: 0.037112 Sep 08 16:09:10.596429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 87/193] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:10 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:09:10.599298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:10.599835 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:10.606593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:10.607075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:10.607529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:10.608374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:10.609214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:10.609815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:10.749714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:10.752294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:10.761010 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:10.761503 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:10.761934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:10.762797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:10.763402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:10.764185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:10.780131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] HTTP exception thrown: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Request method failure captured: Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625/os-volume_attachments HTTP/1.1 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNiXDrZy2i8rASsWz0ZqpRob8G5SL36syax1duR1lEiR182zE9NRl4wGp7Xk0aPmL_hFFw2E_lx2pKyCUKPMOLTJa-GuH1FZ02rX_I6CJY97PKtMgx_tlrZlpHmTx7YOk0MVEbTYTErKZqgTlhTHjTicKuopAkjKTLqn9XR1qAdWH8 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:09:10.781922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be0b2aab8dbf41a7a3c590ca61f022f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}] Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 675b1a5759844cdaa7e0bf071a3ee030 Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.783284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'server_id': 'e43cfdfd-dab3-4549-8e16-09873ba10625'} Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:09:10.787417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:10.788467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:10.789567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Returning 404 to user: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:09:10.789567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c76b098c-cc8c-4b7c-83e7-348fe1821f14 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038534 Sep 08 16:09:10.789567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 88/194] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:09:10 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:09:10.789946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:10.796812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8a613378-07ca-4270-89f6-59819498932b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.207530 Sep 08 16:09:10.798233 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 107/195] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:10 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:11.823702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:11.824283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:11.832978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:11.833459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:11.833941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:11.834946 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:11.835471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:11.836113 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:11.974552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:11.981741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4c0f1135-516c-42f2-b8ad-43f1b803158a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.164109 Sep 08 16:09:11.982282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 89/196] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:11 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:12.037634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:12.038168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:12.047810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:12.048680 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:12.049264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:12.050135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:12.050875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:12.051427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:12.067544 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] HTTP exception thrown: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Request method failure captured: Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 HTTP/1.1 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNiXDrZy2i8rASsWz0ZqpRob8G5SL36syax1duR1lEiR182zE9NRl4wGp7Xk0aPmL_hFFw2E_lx2pKyCUKPMOLTJa-GuH1FZ02rX_I6CJY97PKtMgx_tlrZlpHmTx7YOk0MVEbTYTErKZqgTlhTHjTicKuopAkjKTLqn9XR1qAdWH8 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:09:12.073273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be0b2aab8dbf41a7a3c590ca61f022f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}] Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 675b1a5759844cdaa7e0bf071a3ee030 Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.074728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'e43cfdfd-dab3-4549-8e16-09873ba10625'} Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:09:12.075543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.076860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.078990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Returning 404 to user: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:09:12.080758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8e6200e5-603d-4936-b625-95420511eede tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 404 len: 111 microversion: 2.1 time: 0.047275 Sep 08 16:09:12.081626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 108/197] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:09:12 2022] DELETE /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:09:12.091208 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:12.091933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] [instance: e43cfdfd-dab3-4549-8e16-09873ba10625] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:12.098715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:12.099900 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:12.100593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:12.101423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:12.102086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:12.102568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:12.121854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] HTTP exception thrown: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Request method failure captured: Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 HTTP/1.1 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNiXDrZy2i8rASsWz0ZqpRob8G5SL36syax1duR1lEiR182zE9NRl4wGp7Xk0aPmL_hFFw2E_lx2pKyCUKPMOLTJa-GuH1FZ02rX_I6CJY97PKtMgx_tlrZlpHmTx7YOk0MVEbTYTErKZqgTlhTHjTicKuopAkjKTLqn9XR1qAdWH8 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:09:12.123588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be0b2aab8dbf41a7a3c590ca61f022f8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be0b2aab8dbf41a7a3c590ca61f022f8"}]}] Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: be0b2aab8dbf41a7a3c590ca61f022f8 Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-DeleteServersTestJSON-1573479494 Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 675b1a5759844cdaa7e0bf071a3ee030 Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-DeleteServersTestJSON-1573479494-project Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.124779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'e43cfdfd-dab3-4549-8e16-09873ba10625'} Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:09:12.125894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. Sep 08 16:09:12.127176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:09:12.128188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] Returning 404 to user: Instance e43cfdfd-dab3-4549-8e16-09873ba10625 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:09:12.128188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9b60a175-7ab4-4643-aa3d-2049ee430299 tempest-DeleteServersTestJSON-1573479494 tempest-DeleteServersTestJSON-1573479494-project] 10.222.0.27 "GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625" status: 404 len: 111 microversion: 2.1 time: 0.038653 Sep 08 16:09:12.129448 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 90/198] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:12 2022] GET /compute/v2.1/servers/e43cfdfd-dab3-4549-8e16-09873ba10625 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:09:13.005101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:13.005701 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:13.015104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:13.015730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:13.016342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:13.017038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:13.017484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:13.017901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:13.236041 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:13.247848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-19f216be-4d42-43f4-b3b2-00fabc4aa2ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.246710 Sep 08 16:09:13.248527 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 109/199] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:12 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:14.270669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:14.271273 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:14.284109 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:14.284783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:14.285366 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:14.286698 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:14.288431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:14.289306 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:14.547845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:14.559862 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cd342090-7418-4944-85f4-d959cc849726 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.290272 Sep 08 16:09:14.562518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 91/200] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:14 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:15.587745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:15.588379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:15.603965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:15.605783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:15.607394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:15.610260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:15.611949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:15.613984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:15.856343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:15.869573 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5abd0ca2-cd45-43fd-a499-dcf80e76d29e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.285357 Sep 08 16:09:15.871496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 110/201] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:15 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:16.892912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:16.893576 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:16.901142 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:16.901621 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:16.902357 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:16.908312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:16.909078 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:16.909520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:17.060971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:17.068834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e3ff59a-4cc0-4601-b18c-8070bfd7021b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.180203 Sep 08 16:09:17.069395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 92/202] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:16 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:18.096703 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:18.097475 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:18.104068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:18.104689 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:18.105266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:18.106337 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:18.106815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:18.107240 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:18.272539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:18.284799 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b00e0bb0-abfa-4788-bc82-b23d5c9131fa tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.195258 Sep 08 16:09:18.287252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 111/203] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:18 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:19.313319 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:19.314213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:19.333811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:19.334298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:19.334732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:19.335467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:19.335908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:19.338607 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:19.605768 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:19.617169 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d625e4ff-6c4f-402f-9bc1-7d3219757f77 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.307566 Sep 08 16:09:19.631971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 93/204] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:19 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:20.640595 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:20.641397 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:20.647523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:20.648327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:20.649001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:20.649908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:20.650625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:20.651401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:20.694356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:20.968979 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:20.980105 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a3c2c241-f108-4d01-8a78-c6cc3bd2a0f9 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.343229 Sep 08 16:09:20.981249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 112/205] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:20 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:22.013289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:22.014857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:22.023815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:22.025512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:22.026411 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:22.030121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:22.031334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:22.032623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:22.230127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:22.239631 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f94b433c-9e9e-4e6c-a89b-cc25368fd3c7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.238587 Sep 08 16:09:22.255824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 94/206] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:21 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:22.871554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0f82342b-ccb3-4366-a809-c80416592995 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: .version_select at 0x7f88602bb0d0>, body: {"keypair": {"name": "tempest-keypair-1134768320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPZqqcwh2Ykdw4lELNpkUofvKk0AWgb9Ngocg5lKTYa/N6upCWD6M19Rh/H0oGcPmqUQS0Kk8Pe6mdFJAxF6v3iUnYDRLzDIUi34P7qYEJ8MgJJlPLN7Xcmr57Q1zqH8Q=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:22.890409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-0f82342b-ccb3-4366-a809-c80416592995 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for project c67853e0ad324ac595650e59f9a90f56. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:09:22.895574 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-0f82342b-ccb3-4366-a809-c80416592995 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for user 965cbbdb06c248698ef54527c29767df and project c67853e0ad324ac595650e59f9a90f56. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:09:22.931229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0f82342b-ccb3-4366-a809-c80416592995 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.362000 Sep 08 16:09:22.932065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 113/207] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:09:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:23.265914 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:23.266331 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:23.295180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:23.295992 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:23.296515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:23.297384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:23.297844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:23.298370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:23.511190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:23.520861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fa25e5f6-3f74-4cf3-852b-860b50549b39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.261932 Sep 08 16:09:23.522013 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 95/208] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:23 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:24.540396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1224765957", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9938b0f8-8ae3-4efd-981a-26cf6a9b4e30"}], "security_groups": [{"name": "tempest-securitygroup--1543581387"}], "key_name": "tempest-keypair-1134768320", "user_data": "}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:24.544617 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:24.545223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:24.552075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:24.552794 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:24.553406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:24.554102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:24.554745 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:24.555351 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:24.562089 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:24.732126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] validate_networks() for [('9938b0f8-8ae3-4efd-981a-26cf6a9b4e30', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:09:24.742461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:24.756284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-498fddc9-a55f-40b1-8a3f-40ec6f636cc5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.215474 Sep 08 16:09:24.756867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 96/209] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:24 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:25.196670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:09:25.197222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:09:25.197827 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:09:25.198345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:09:25.198704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:09:25.230036 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:25.230528 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:25.230932 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:25.231665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:25.232106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:25.232518 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:25.268953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for project c67853e0ad324ac595650e59f9a90f56. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:09:25.278134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for user 965cbbdb06c248698ef54527c29767df and project c67853e0ad324ac595650e59f9a90f56. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:09:25.292544 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:09:25.295414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:09:25.354912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e133e8d8-0081-4bd9-9d6c-a06358e372b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.818974 Sep 08 16:09:25.355912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 114/210] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:09:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:09:25.368058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f768326b-b098-4876-8621-882ce1c2c754 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:25.368968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f768326b-b098-4876-8621-882ce1c2c754 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:25.495710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f768326b-b098-4876-8621-882ce1c2c754 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:25.504117 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f768326b-b098-4876-8621-882ce1c2c754 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1238 microversion: 2.1 time: 0.139844 Sep 08 16:09:25.508038 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 97/211] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:25 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1238 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:25.781609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:25.783106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:25.791020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:25.792088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:25.792792 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:25.794105 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:25.794726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:25.795314 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:25.948608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:25.958279 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-65923256-ee8a-4a61-987a-dea1d2e13c52 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.180869 Sep 08 16:09:25.958798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 115/212] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:25 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:26.534549 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:26.535134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:26.544251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:26.544739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:26.545180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:26.546007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:26.546468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:26.546896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:26.611131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:26.620286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d841755b-9ef7-4221-be91-9fe4cf827ef9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1290 microversion: 2.1 time: 0.090230 Sep 08 16:09:26.624536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 98/213] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:26 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:26.982798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:26.983401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:26.989440 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:26.989916 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:26.990341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:26.991025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:26.991496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:26.991914 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:27.137323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:27.146022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ad02a3ac-5889-453e-b389-9cbba0390f3b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1520 microversion: 2.1 time: 0.167048 Sep 08 16:09:27.146771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 116/214] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:26 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:27.647067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:27.647929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:27.658292 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:27.659179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:27.659687 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:27.660922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:27.661436 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:27.662097 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:27.741743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:27.754259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-53c33d59-ae89-41dd-aff7-bb0899e17771 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1298 microversion: 2.1 time: 0.113279 Sep 08 16:09:27.754832 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 99/215] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:27 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:28.170219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:28.171811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:28.179016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.179819 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.180475 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.181567 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.182232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.182864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.306902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbd5ea4c-831c-42ac-8ead-78f9e66b9d2a", "device": "/dev/sdb"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:28.310606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:28.317927 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.318641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.319348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.320662 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.321369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.322120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.360509 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:28.369218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0c302573-df9f-470a-af05-9789e54b64c0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1500 microversion: 2.1 time: 0.203904 Sep 08 16:09:28.386719 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 117/216] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:28 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1500 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:28.392252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:28.392846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:28.399399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.400151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.400774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.401619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.402218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.402787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.586848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:28.594938 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-444e6149-1745-4cfa-a1a5-e8c53972e77e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1513 microversion: 2.1 time: 0.206605 Sep 08 16:09:28.595767 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 118/217] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:28 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:28.625077 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:28.658564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-885c522b-900d-4322-a4af-28b982dc2b79 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "POST /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355475 Sep 08 16:09:28.665177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 100/218] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:09:28 2022] POST /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:09:28.777345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:28.778162 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:28.784120 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.785044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.785738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.786888 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:28.787351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:28.787923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:28.870075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:28.877982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f376e6cf-9f05-497e-b010-1ecac5d168d1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1296 microversion: 2.1 time: 0.104504 Sep 08 16:09:28.878562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 119/219] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:28 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:29.774697 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-34033716-efd4-4f9b-9af7-fce47ec9c6c9 req-178cca53-cdf6-4ded-bdc0-f0b5f9e860e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3328192d-87f0-46fe-97e1-57559cb1318b", "tag": "060e2941-482e-4264-ae48-05f43e053bb4"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:29.790300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:29.792912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-34033716-efd4-4f9b-9af7-fce47ec9c6c9 req-178cca53-cdf6-4ded-bdc0-f0b5f9e860e9 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:29.793421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-34033716-efd4-4f9b-9af7-fce47ec9c6c9 req-178cca53-cdf6-4ded-bdc0-f0b5f9e860e9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:29.794402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-34033716-efd4-4f9b-9af7-fce47ec9c6c9 req-178cca53-cdf6-4ded-bdc0-f0b5f9e860e9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:29.811251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-34033716-efd4-4f9b-9af7-fce47ec9c6c9 req-178cca53-cdf6-4ded-bdc0-f0b5f9e860e9 service nova] Creating event network-changed:060e2941-482e-4264-ae48-05f43e053bb4 for instance 3328192d-87f0-46fe-97e1-57559cb1318b on hv-cinder-85625 Sep 08 16:09:29.816498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-34033716-efd4-4f9b-9af7-fce47ec9c6c9 req-178cca53-cdf6-4ded-bdc0-f0b5f9e860e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051207 Sep 08 16:09:29.817096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 101/220] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:29.903779 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:29.904621 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:29.912629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:29.913114 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:29.913534 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:29.914341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:29.914788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:29.915249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:30.044639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:30.052322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-66d20091-c377-4379-8ccc-e5164f2c2d85 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.152742 Sep 08 16:09:30.052893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 120/221] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:29 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:30.099669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:30.102049 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:30.108471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:30.108945 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:30.109373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:30.110248 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:30.110858 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:30.111283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:30.134555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'flavor' on Instance uuid fbcc5ea9-0755-493f-9c67-4a0d0076df04 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:09:30.259815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-63e5d141-2b5d-4331-9dc2-7a3c23032976 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/action" status: 200 len: 32 microversion: 2.1 time: 0.165062 Sep 08 16:09:30.260441 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 102/222] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:09:30 2022] POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:09:30.270221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:30.271129 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:30.278341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:30.278916 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:30.279478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:30.280287 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:30.280801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:30.281406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:30.415706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:30.423774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5b60a1f7-d3de-4435-9ce9-2fe0bc0f59fc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.157717 Sep 08 16:09:30.424430 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 121/223] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:30 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:31.078200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:31.079179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:31.086230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:31.086773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:31.087258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:31.088304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:31.089157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:31.089810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:31.449973 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:31.450558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:31.468677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:31.469155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:31.469825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:31.470560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:31.471175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:31.471617 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:31.614074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:31.621971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-14eb8de6-8c07-4b7b-a4c2-69ca872273d8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.176298 Sep 08 16:09:31.622773 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 122/224] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:31 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:31.634093 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:31.642971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-089016b4-9d93-4eaa-b911-ffa6b190bee0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.569740 Sep 08 16:09:31.645865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 103/225] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:31 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:32.646553 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:32.647238 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:32.655197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:32.655674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:32.656067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:32.656801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:32.657341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:32.657799 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:32.667944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:32.668617 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:32.675403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:32.675909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:32.676339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:32.677016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:32.677460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:32.677956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:32.793352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:32.801161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-51a40be3-afad-48a9-b3a5-6c56be484edc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.159388 Sep 08 16:09:32.801832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 123/226] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:32 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:32.827799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:32.835638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-aec480d3-d0cb-48f8-8efe-3925ddff46ad tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.171627 Sep 08 16:09:32.836213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 104/227] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:32 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:33.823992 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:33.824735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:33.833384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:33.834086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:33.834715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:33.835793 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:33.836433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:33.836990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:33.858460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:33.859028 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:33.869962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:33.870685 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:33.871205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:33.872033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:33.872555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:33.873050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:34.018169 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:34.027535 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-07e70709-8801-472c-940a-2b5c048721be tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.172962 Sep 08 16:09:34.028277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 105/228] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:33 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:34.202560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:34.210487 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d6c19e02-c956-4dc0-9d81-33b888fe229a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.390903 Sep 08 16:09:34.211061 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 124/229] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:33 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:35.051095 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:35.051731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:35.059856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:35.060376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:35.060830 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:35.061536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:35.061981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:35.062400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:35.197758 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:35.205998 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3b720648-fe93-4569-a53c-bbc63d890aab tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.159052 Sep 08 16:09:35.206572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 106/230] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:35 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:35.233920 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:35.234525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:35.239811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:35.241561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:35.242040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:35.242466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:35.243157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:35.243641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:35.244062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:35.287775 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=10 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:35.376037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:35.384303 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-67a7b2ae-ce18-473a-8359-72c903d7c829 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.154300 Sep 08 16:09:35.384875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 125/231] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:35 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:36.229255 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:36.229806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:36.231855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:36.237836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:36.238344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:36.238776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:36.239476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:36.239930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:36.240356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:36.394185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:36.403328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-854e031c-2560-41bd-ba6b-644b969f85f7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.177692 Sep 08 16:09:36.404212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 107/232] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:36 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:36.408136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:36.408704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:36.415396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:36.415986 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:36.416661 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:36.417609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:36.418305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:36.418930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:36.561879 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:36.570281 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-602e2269-887e-403d-a7be-9e818f4e80f0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.166282 Sep 08 16:09:36.570909 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 126/233] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:36 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:37.431974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:37.433002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:37.441207 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:37.441715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:37.442143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:37.442872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:37.443323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:37.443811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:37.581432 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:37.589575 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-86f23160-20b3-4fdd-a8d5-9913676122f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.164291 Sep 08 16:09:37.590145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 108/234] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:37 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:37.594009 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:37.594835 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:37.601727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:37.602313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:37.602807 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:37.603649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:37.604193 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:37.604646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:37.741751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:37.750062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-202d075e-1f3d-4f78-a613-90b66a8b73bd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.160404 Sep 08 16:09:37.750659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 127/235] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:37 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:38.612549 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:38.613128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:38.619342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:38.619857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:38.620306 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:38.621016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:38.621485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:38.622128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:38.762655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:38.770560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-124b9269-9657-4820-9af9-9f13360ac9bc tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.162079 Sep 08 16:09:38.771305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 109/236] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:38 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:38.773926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:38.774530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:38.786414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:38.787156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:38.787766 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:38.788788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:38.789430 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:38.790095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:38.924555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:38.933758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0563e250-8f06-4a26-b33c-7fc23850129f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.164154 Sep 08 16:09:38.934418 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 128/237] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:38 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:39.797622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:39.798946 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:39.809845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:39.810591 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:39.811218 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:39.812477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:39.812925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:39.813342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:39.947073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:39.958634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-81f27329-8c15-4e29-8a18-be8d8082df21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.167087 Sep 08 16:09:39.959399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 110/238] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:39 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:39.964380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:39.964991 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:39.971212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:39.971700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:39.972338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:39.973049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:39.973506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:39.973926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:40.108741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:40.116911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-18f05339-4dca-4166-ab5f-4aea13bc665a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.156378 Sep 08 16:09:40.117453 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 129/239] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:39 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:40.981299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:40.981872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:40.989610 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:40.990106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:40.990545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:40.991263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:40.991745 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:40.992179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:41.134488 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:41.139676 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:41.140380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:41.142557 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-137cb54b-7db4-4a2d-85b2-01e26dfb3168 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.165542 Sep 08 16:09:41.143145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 111/240] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:40 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:41.146587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:41.147108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:41.147558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:41.148399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:41.148846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:41.149286 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:41.285398 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:41.288842 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:41.293790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa0b59bf-bd28-480c-8fca-48871a764ad8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.158014 Sep 08 16:09:41.294355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 130/241] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:41 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:42.169331 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:42.170036 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:42.178658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:42.179277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:42.179871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:42.180745 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:42.181318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:42.181850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:42.317742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:42.318474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:42.324737 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:42.325218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:42.325643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:42.326332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:42.326780 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:42.327197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:42.334390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:42.342485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d81b92dc-7e88-4cec-b219-f2ce9c377d4e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.180119 Sep 08 16:09:42.343048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 112/242] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:42 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:42.463117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:42.471765 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9c69a5e1-cea3-4a63-b521-ab302553c273 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.158637 Sep 08 16:09:42.472364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 131/243] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:42 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:43.367478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:43.369386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:43.378084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:43.378564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:43.379014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:43.379725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:43.380179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:43.380603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:43.494345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:43.494923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:43.502884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:43.503358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:43.503812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:43.504504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:43.504945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:43.505365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:43.516340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:43.524165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-325f2631-7a26-4d2e-b26e-10850d07c0f1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.161962 Sep 08 16:09:43.524739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 113/244] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:43 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:43.635173 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:43.649671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3ac110d7-8efa-4cd1-bd7c-c4afc937fb76 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.159041 Sep 08 16:09:43.650142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 132/245] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:43 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:44.550508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:44.551896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:44.558156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:44.558629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:44.559058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:44.559796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:44.560240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:44.560659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:44.674645 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:44.675564 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:44.684677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:44.685201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:44.685633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:44.686332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:44.686816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:44.687231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:44.697202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:44.705288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-81987ba2-b99c-4bb9-a5ce-4953a43f65f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.161434 Sep 08 16:09:44.705947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 114/246] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:44 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:44.820209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:44.828510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bbb60df5-5161-46a4-8893-116bb7a7595a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.158962 Sep 08 16:09:44.829332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 133/247] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:44 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:45.732160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:45.732920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:45.743017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:45.743795 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:45.744350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:45.745046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:45.745501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:45.745921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:45.765754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:45.852220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:45.852926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:45.859832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:45.860402 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:45.861027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:45.862036 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:45.862479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:45.862873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:45.901322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:45.909308 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5b450f74-44ac-48dc-b67b-09817041890a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.183003 Sep 08 16:09:45.909892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 115/248] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:45 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:45.995234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:46.004670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bcdb5c0e-1537-4645-96fb-33b3a1fdbfb8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.157361 Sep 08 16:09:46.005252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 134/249] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:45 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:46.935597 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:46.936518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:46.947807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:46.948287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:46.948715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:46.949395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:46.949846 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:46.950262 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:47.028164 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:47.028751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:47.037099 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:47.037588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:47.038013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:47.038704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:47.039153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:47.039607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:47.085163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:47.093141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b06af1ce-68cb-49ea-a137-dbd53d9c251b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.164050 Sep 08 16:09:47.097647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 116/250] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:46 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:47.175771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:47.183788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ed6d7307-718d-44b6-bd4b-bbfa07924c02 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.159576 Sep 08 16:09:47.184563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 135/251] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:47 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:48.120168 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:48.120769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:48.127796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:48.128276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:48.128691 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:48.129383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:48.129831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:48.130815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:48.207296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:48.208027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:48.214357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:48.214904 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:48.215405 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:48.216175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:48.216709 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:48.217243 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:48.261447 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:48.269193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-99cd11ea-d78a-461d-9480-5b884cd7e845 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.155551 Sep 08 16:09:48.269759 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 117/252] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:48 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:48.347695 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:48.357498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-477a22cc-a77c-4627-b506-bf9e270490d3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.154285 Sep 08 16:09:48.358066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 136/253] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:48 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:49.291931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:49.292552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:49.299605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:49.300113 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:49.300548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:49.301252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:49.301708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:49.302166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:49.380529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:49.381153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:49.387404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:49.387939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:49.389017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:49.389715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:49.390169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:49.390588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:49.434412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:49.441133 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-027b4cb2-170a-45b7-a589-00321c816f84 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.153397 Sep 08 16:09:49.441714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 118/254] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:49 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:49.524171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:49.532221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9602fb6d-90f9-47e6-adb4-00c30caa7a2b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.155694 Sep 08 16:09:49.532794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 137/255] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:49 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:50.468540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:50.469514 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:50.479931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:50.480416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:50.480851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:50.481534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:50.481988 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:50.482414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:50.555268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:50.555867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:50.562151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:50.562638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:50.563069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:50.563801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:50.564259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:50.564683 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:50.615976 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:50.628561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c727416f-eeb8-4fb2-a2fa-7160f4848b9b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.166666 Sep 08 16:09:50.629889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 119/256] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:50 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:50.715847 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:50.723784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-17894b5c-2922-407b-8ff2-275efaef55d7 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.172455 Sep 08 16:09:50.724266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 138/257] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:50 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:50.738218 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-a5689409-7445-4090-9b77-827813e2f835 req-d1635d93-94bc-4e19-8bc7-8aaf39af0c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3328192d-87f0-46fe-97e1-57559cb1318b", "name": "network-vif-plugged", "status": "completed", "tag": "060e2941-482e-4264-ae48-05f43e053bb4"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:50.749395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-a5689409-7445-4090-9b77-827813e2f835 req-d1635d93-94bc-4e19-8bc7-8aaf39af0c63 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:50.749965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-a5689409-7445-4090-9b77-827813e2f835 req-d1635d93-94bc-4e19-8bc7-8aaf39af0c63 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:50.750278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-a5689409-7445-4090-9b77-827813e2f835 req-d1635d93-94bc-4e19-8bc7-8aaf39af0c63 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:50.762553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-a5689409-7445-4090-9b77-827813e2f835 req-d1635d93-94bc-4e19-8bc7-8aaf39af0c63 service nova] Creating event network-vif-plugged:060e2941-482e-4264-ae48-05f43e053bb4 for instance 3328192d-87f0-46fe-97e1-57559cb1318b on hv-cinder-85625 Sep 08 16:09:50.767857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-a5689409-7445-4090-9b77-827813e2f835 req-d1635d93-94bc-4e19-8bc7-8aaf39af0c63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Sep 08 16:09:50.768728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 120/258] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:51.653382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:51.654348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:51.662406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:51.663082 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:51.663556 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:51.664366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:51.664815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:51.665375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:51.747129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:51.747854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:51.754485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:51.754960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:51.755387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:51.756096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:51.756559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:51.756956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:51.799323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:51.809857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4ddfc444-57aa-4646-94d9-840a5fbb1c9e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1364 microversion: 2.1 time: 0.161537 Sep 08 16:09:51.810695 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 139/259] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:51 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:51.888657 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:51.896377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-66f1b3af-7580-401b-8b9a-dbc0bba65c24 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.153679 Sep 08 16:09:51.896914 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 121/260] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:51 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:09:52.832720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:52.833310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:52.839883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:52.840388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:52.840965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:52.841699 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:52.842235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:52.842654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:52.920267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:52.920872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:52.927628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:52.928108 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:52.928534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:52.929202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:52.929646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:52.930064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:52.984340 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:52.992339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-56808fe0-3a63-4084-9053-1ef9ed5a7274 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1549 microversion: 2.1 time: 0.163666 Sep 08 16:09:52.992922 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 140/261] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:52 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:53.014393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:53.014883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:53.020925 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:53.021429 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:53.021857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:53.022588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:53.023035 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:53.023483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:53.064105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:53.072390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e67fa727-b409-4bc1-a1fe-706fa29d745c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.156077 Sep 08 16:09:53.072971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 122/262] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:52 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:53.102850 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-eba3c30b-b2df-4fee-a72a-f4d8273bbbfa tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092306 Sep 08 16:09:53.103466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 141/263] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:09:53 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:09:53.585979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:53.586540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:53.594765 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:53.595259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:53.595731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:53.604742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:53.605224 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:53.605704 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:53.738936 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lazy-loading 'services' on Instance uuid 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:09:53.856571 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-62532467-1284-403f-8660-6be2d1bfeab1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9/os-volume_attachments/fbd5ea4c-831c-42ac-8ead-78f9e66b9d2a" status: 202 len: 0 microversion: 2.1 time: 0.275224 Sep 08 16:09:53.857172 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 123/264] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:09:53 2022] DELETE /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9/os-volume_attachments/fbd5ea4c-831c-42ac-8ead-78f9e66b9d2a => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:09:54.067835 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-5ad66e4a-b3df-406c-9c27-60be70e4d61c req-85f89d7c-11f4-4406-8526-8e00246e2b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3328192d-87f0-46fe-97e1-57559cb1318b", "tag": "060e2941-482e-4264-ae48-05f43e053bb4"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:54.078547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5ad66e4a-b3df-406c-9c27-60be70e4d61c req-85f89d7c-11f4-4406-8526-8e00246e2b13 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:54.078978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5ad66e4a-b3df-406c-9c27-60be70e4d61c req-85f89d7c-11f4-4406-8526-8e00246e2b13 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:54.079396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5ad66e4a-b3df-406c-9c27-60be70e4d61c req-85f89d7c-11f4-4406-8526-8e00246e2b13 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:54.090825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-5ad66e4a-b3df-406c-9c27-60be70e4d61c req-85f89d7c-11f4-4406-8526-8e00246e2b13 service nova] Creating event network-changed:060e2941-482e-4264-ae48-05f43e053bb4 for instance 3328192d-87f0-46fe-97e1-57559cb1318b on hv-cinder-85625 Sep 08 16:09:54.096344 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-5ad66e4a-b3df-406c-9c27-60be70e4d61c req-85f89d7c-11f4-4406-8526-8e00246e2b13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032197 Sep 08 16:09:54.097311 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 142/265] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:09:54.098982 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:54.099870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:54.107034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:54.107558 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:54.108016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:54.108711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:54.109156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:54.109574 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:54.247426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:54.255298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3b2afde9-74bc-4090-9acc-99ce2c4de129 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.162714 Sep 08 16:09:54.255927 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 124/266] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:54 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:55.280843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:55.282645 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:55.284885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:55.291217 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:55.291770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:55.292586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:55.293293 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:55.293822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:55.294339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:55.433641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:55.441918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f1d63895-7786-4b43-be55-9b51d3b5e0cf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.166121 Sep 08 16:09:55.442499 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 143/267] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:55 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:56.078629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:56.079260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:56.086159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:56.086661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:56.087101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:56.087819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:56.088271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:56.088693 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:56.117630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:09:56.202744 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e91ef40-5ef8-4009-95dd-6219a1663df4 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 204 len: 0 microversion: 2.1 time: 0.128135 Sep 08 16:09:56.203699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 125/268] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:09:56 2022] DELETE /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:09:56.214864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:56.216885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:56.230797 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:56.231859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:56.232490 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:56.233500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:56.235070 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:56.235751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:56.366670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:56.374547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-122b1b3c-38a0-423d-9781-b426852207b6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1514 microversion: 2.1 time: 0.166488 Sep 08 16:09:56.375113 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 144/269] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:56 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:56.466850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:56.467625 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:56.473579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:56.474053 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:56.474468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:56.475157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:56.475628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:56.476043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:56.617350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:56.625598 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1a2e84bc-add8-4a72-ace2-7b715670c04e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.163332 Sep 08 16:09:56.626298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 126/270] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:56 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:57.398366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:57.399147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:57.408625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:57.408625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:57.408625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:57.408625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:57.409028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:57.409028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:57.589011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:57.596744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b0af682a-9015-4167-aefd-423a55fa21ae tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1514 microversion: 2.1 time: 0.202499 Sep 08 16:09:57.597616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 145/271] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:57 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:57.649223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:57.650604 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:57.658368 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:57.659337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:57.660315 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:57.661779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:57.662587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:57.663176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:57.809030 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:57.825246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2dcbfb57-dbb5-43b5-9505-19641cb7b884 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.179706 Sep 08 16:09:57.826143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 127/272] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:57 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:58.619844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:58.621269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:58.627533 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:58.628281 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:58.628687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:58.629381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:58.629873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:58.630274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:58.791955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:58.801963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-12a58b45-7124-48f7-8a0e-b40d37c9264a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1514 microversion: 2.1 time: 0.186002 Sep 08 16:09:58.802924 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 146/273] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:58 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:58.853366 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:58.853987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:58.862999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:58.863518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:58.863958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:58.864665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:58.865131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:58.865553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.062822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-742721019", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:59.087195 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:59.094990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eae2dd37-98e9-4f3f-b60c-31e739e976e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.246030 Sep 08 16:09:59.095907 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 128/274] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:58 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:59.121627 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] validate_networks() for None {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:09:59.213548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-116f9ded-a54f-45ae-ad26-24390889b1d8 req-09ce5101-39e8-47f6-8f8b-3d6634e3351e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63cd6d-611a-46da-a40f-cc3360c0c0a9", "name": "network-vif-deleted", "tag": "f1e819b2-5c8d-4007-bb6f-892f5b55da8c"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:09:59.225065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-116f9ded-a54f-45ae-ad26-24390889b1d8 req-09ce5101-39e8-47f6-8f8b-3d6634e3351e service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:59.225548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-116f9ded-a54f-45ae-ad26-24390889b1d8 req-09ce5101-39e8-47f6-8f8b-3d6634e3351e service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:59.225974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-116f9ded-a54f-45ae-ad26-24390889b1d8 req-09ce5101-39e8-47f6-8f8b-3d6634e3351e service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.238357 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-116f9ded-a54f-45ae-ad26-24390889b1d8 req-09ce5101-39e8-47f6-8f8b-3d6634e3351e service nova] Creating event network-vif-deleted:f1e819b2-5c8d-4007-bb6f-892f5b55da8c for instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 on hv-cinder-85625 Sep 08 16:09:59.243474 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-116f9ded-a54f-45ae-ad26-24390889b1d8 req-09ce5101-39e8-47f6-8f8b-3d6634e3351e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034292 Sep 08 16:09:59.248089 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 129/275] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:09:59.426148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:09:59.426763 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:09:59.427230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:09:59.427663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:09:59.428065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:09:59.437267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:59.437677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:59.438101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.438808 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:59.439249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:59.439688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.456785 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Getting quotas for project 19a3e27d765147298f6d421fc614f77f. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:09:59.460887 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Getting quotas for user f66138a7d2594933b09e1fcc7a4c2f1a and project 19a3e27d765147298f6d421fc614f77f. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:09:59.473814 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:09:59.476210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:09:59.521093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-55ab1aa5-8017-4cbf-9430-66cf9abc0f25 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.462133 Sep 08 16:09:59.521712 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 147/276] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:09:59.533967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9f02a064-89a5-4919-97f0-6d23b2e5120e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:59.534657 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9f02a064-89a5-4919-97f0-6d23b2e5120e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:59.603925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9f02a064-89a5-4919-97f0-6d23b2e5120e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:59.612779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9f02a064-89a5-4919-97f0-6d23b2e5120e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1214 microversion: 2.1 time: 0.083117 Sep 08 16:09:59.615538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 130/277] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:59 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:09:59.826167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:09:59.827019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:09:59.834104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:59.834653 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:59.835147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.835961 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:59.836532 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:59.837024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.879814 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:09:59.880285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:09:59.880718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:09:59.881163 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lazy-loading 'fault' on Instance uuid 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:09:59.927394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:09:59.931169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:09:59.936880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0988251a-3fc9-42eb-bf90-2b02cb24fe8a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 200 len: 1309 microversion: 2.1 time: 0.114892 Sep 08 16:09:59.937455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 148/278] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:09:59 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:00.118644 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:00.119974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:00.123681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:00.129065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:00.129632 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:00.130454 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:00.132144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:00.133085 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:00.133731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:00.305497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:00.314067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7b20f6c7-7544-4b5e-8c26-53ae2eea5172 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.199152 Sep 08 16:10:00.315647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 131/279] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:00 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:00.639722 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:00.640391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:00.647706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:00.648266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:00.648821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:00.649667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:00.650167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:00.650672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:00.720413 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:00.729897 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-71b2dd3f-45a6-4a9f-82c2-70939da5e7cd tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1210 microversion: 2.1 time: 0.096683 Sep 08 16:10:00.730488 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 149/280] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:00 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:00.963846 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:00.964950 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 8c63cd6d-611a-46da-a40f-cc3360c0c0a9] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:00.971782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:00.972263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:00.972684 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:00.973367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:00.973815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:00.974225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:00.978131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:00.988912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] HTTP exception thrown: Instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 could not be found. Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Request method failure captured: Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 HTTP/1.1 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhONjZ7UwcM7XmrZEde7znZUd7lIpTqNKKLj2HOLdPOCmsvSgquzeGRj5M05IQg4Q-ukszozhRuRH_dPQC-Xk1V4SnCyTqMgjaAaGulmC3fw9eShSIHhSbwKG6fceA5SoXd0P8Qc9X3SO7CAb4mScXbo1jVUg3mtcyhS-9s7Nkz22o0 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: bafdc72abf95401f8784411bc8e55822 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesSnapshotTestJSON-502902543 Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:10:00.990776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bafdc72abf95401f8784411bc8e55822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bafdc72abf95401f8784411bc8e55822", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bafdc72abf95401f8784411bc8e55822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bafdc72abf95401f8784411bc8e55822"}]}] Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-VolumesSnapshotTestJSON-502902543 Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: bafdc72abf95401f8784411bc8e55822 Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-502902543 Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-VolumesSnapshotTestJSON-502902543-project Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 2127487c50884141b2776f05e96471fd Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-VolumesSnapshotTestJSON-502902543-project Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 could not be found. Sep 08 16:10:00.992263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '8c63cd6d-611a-46da-a40f-cc3360c0c0a9'} Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 could not be found. Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:10:00.993076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 could not be found. Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 could not be found. Sep 08 16:10:00.994201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:00.995219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Returning 404 to user: Instance 8c63cd6d-611a-46da-a40f-cc3360c0c0a9 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:10:00.995219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f326dc25-d43f-4396-89cb-22cd7a242645 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9" status: 404 len: 111 microversion: 2.1 time: 0.035184 Sep 08 16:10:00.995219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 132/281] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:00 2022] GET /compute/v2.1/servers/8c63cd6d-611a-46da-a40f-cc3360c0c0a9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:10:01.338696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:01.340651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:01.348388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:01.348871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:01.349492 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:01.350674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:01.351313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:01.351770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:01.526769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:01.534537 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-65b5d645-a8d2-4713-9ffd-7ca784f86c9d tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.201160 Sep 08 16:10:01.535101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 150/282] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:01 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:01.754601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:01.755212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:01.766711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:01.767346 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:01.767949 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:01.768742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:01.769300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:01.769839 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:01.837373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:01.845510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fd7e8d70-a0f4-409a-8b9b-de0ad669b19d tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1266 microversion: 2.1 time: 0.096584 Sep 08 16:10:01.846075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 133/283] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:01 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:02.561951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:02.562750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:02.570950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:02.571590 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:02.572138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:02.572998 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:02.573566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:02.574096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:02.706474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:02.714370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bd8e3968-e86a-4077-b952-9fa61f8df8e0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.158393 Sep 08 16:10:02.714942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 151/284] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:02 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:02.868546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:02.869128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:02.876084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:02.876561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:02.876987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:02.877677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:02.878125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:02.878542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:02.940961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:02.948937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-38a5cf5a-b7cb-40d2-9ac5-6cc95bbc1065 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1266 microversion: 2.1 time: 0.084260 Sep 08 16:10:02.949559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 134/285] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:02 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:02.959708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:02.960205 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:02.966589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:02.967081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:02.967554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:02.968250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:02.968704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:02.969128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:02.992829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9a5efa92-1d8e-426b-9936-a28eb0f24b42 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/ips" status: 200 len: 149 microversion: 2.1 time: 0.037061 Sep 08 16:10:02.993424 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 152/286] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:10:02 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:03.241289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:03.242241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:03.250649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:03.251614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:03.252290 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:03.253181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:03.253809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:03.254423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:03.280209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-33897d1b-ed73-43fb-9696-2c39199a6a3a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/ips" status: 200 len: 151 microversion: 2.20 time: 0.043139 Sep 08 16:10:03.280709 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 135/287] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Sep 8 16:10:03 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:10:03.742567 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:03.744497 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:03.754901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:03.755749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:03.756471 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:03.757602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:03.758355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:03.759062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:03.896613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:03.904921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-336a14da-55f3-4f04-a8e4-1fb73a622996 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.169410 Sep 08 16:10:03.905483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 153/288] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:03 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:03.972332 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:03.972912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:03.980031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:03.980515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:03.980949 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:03.981638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:03.982091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:03.982509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:04.048565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:04.056490 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3e52e664-8c2e-41b2-9b02-b05196ffcdd6 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1266 microversion: 2.1 time: 0.088177 Sep 08 16:10:04.057070 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 136/289] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:03 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:04.927628 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:04.928234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:04.934308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:04.934829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:04.935280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:04.936011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:04.936457 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:04.936933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:05.070048 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:05.078288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0e2dd467-73cd-4ade-a87a-68b6d8c204b8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.154487 Sep 08 16:10:05.079065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 154/290] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:04 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:05.079477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:05.080080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:05.090915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:05.090915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:05.090915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:05.090915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:05.091235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:05.091235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:05.186045 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:05.194934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-000a132c-4346-4d0d-8ad7-d2f1fab2ed5a tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1274 microversion: 2.1 time: 0.119476 Sep 08 16:10:05.195558 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 137/291] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:05 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:05.431201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0674b780-1d8b-4b8f-aa98-5e494cb86672"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:05.434534 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:05.447626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:05.447626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:05.447626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:05.447626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:05.447970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:05.447970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:05.989801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3aa15f79-bd8d-4535-a0df-bb1a6fe2f0ed tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564267 Sep 08 16:10:05.991593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 155/292] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:10:05 2022] POST /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:06.102990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:06.103805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:06.110049 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:06.110636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:06.111268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:06.112205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:06.112731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:06.113227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:06.219990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:06.220730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:06.236113 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:06.237283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:06.237715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:06.238618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:06.239345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:06.240023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:06.314545 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:06.322589 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:06.323016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-10147aa0-072b-462f-b084-2fb94237c6af tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1272 microversion: 2.1 time: 0.108549 Sep 08 16:10:06.331630 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 156/293] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:06 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:06.339958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dd9a35c7-a088-4249-93b6-9e341039a238 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.242023 Sep 08 16:10:06.340993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 138/294] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:06 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:07.347131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:07.347744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:07.355513 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.356218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.356841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.359381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.359381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.359381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.366037 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:07.367411 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:07.376202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.377183 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.377823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.378688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.379292 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.379891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.512410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:07.521024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3ba36839-f83d-4896-bdd6-d0a4fae0ea3e tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.177994 Sep 08 16:10:07.521614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 157/295] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:07 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:07.528939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:07.529717 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:07.536523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.537317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.537814 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.538575 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.539097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.539619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.713718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lazy-loading 'flavor' on Instance uuid b86196fd-45b1-4137-abe6-0dcea457440c {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:10:07.744487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:07.789644 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9a7bd9d7-0ebc-4315-aa67-8587a94ccab2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1499 microversion: 2.1 time: 0.428641 Sep 08 16:10:07.790247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 139/296] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:07 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1499 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:07.822741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-9fb95c3e-9372-45f5-bcbe-282b26c170e6 req-9ad86381-8348-4e6f-b977-8a1e8d6ffa8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd554b25-6522-4017-9629-9ed119f193b6", "tag": "f80b8ad7-51fa-4781-bcb2-e3cf0801f0fe"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:07.834203 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9fb95c3e-9372-45f5-bcbe-282b26c170e6 req-9ad86381-8348-4e6f-b977-8a1e8d6ffa8d service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.834767 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9fb95c3e-9372-45f5-bcbe-282b26c170e6 req-9ad86381-8348-4e6f-b977-8a1e8d6ffa8d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.835199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9fb95c3e-9372-45f5-bcbe-282b26c170e6 req-9ad86381-8348-4e6f-b977-8a1e8d6ffa8d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.846875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-9fb95c3e-9372-45f5-bcbe-282b26c170e6 req-9ad86381-8348-4e6f-b977-8a1e8d6ffa8d service nova] Creating event network-changed:f80b8ad7-51fa-4781-bcb2-e3cf0801f0fe for instance fd554b25-6522-4017-9629-9ed119f193b6 on hv-cinder-85625 Sep 08 16:10:07.852381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-9fb95c3e-9372-45f5-bcbe-282b26c170e6 req-9ad86381-8348-4e6f-b977-8a1e8d6ffa8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060972 Sep 08 16:10:07.853086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 140/297] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:07.859279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8d5f9b0-8628-4612-a15f-7d96efb0c40f"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:07.861773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:07.867978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.868462 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.868893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.869581 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.870042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.870460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.897529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] HTTP exception thrown: Cannot 'attach_volume' instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 while it is in vm_state rescued Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Request method failure captured: Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/os-volume_attachments HTTP/1.1 Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 74 Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNoFW1fgwP5T-ivL1vEtVb4Xaznb9dG5A0WWMjHfg8Fpra-s-xxYZh7-tMiHLTO_DjEJytNHYcDiylJiWewzjGu0mAG8LXLmfm15CD6Qhbg2P7SRIHOUDznqLmi_eUI0BZh1Q5KELX0YJjKFlF3bLDOKR_PftJIwT9izYmT6Bg7bHA Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:10:07.899487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73c9cf0f579144eb80c090456d363a05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}] Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 18375266a64348df879a9eec53bfcbf9 Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {"volumeAttachment": {"volumeId": "f8d5f9b0-8628-4612-a15f-7d96efb0c40f"}} Sep 08 16:10:07.900775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Cannot 'attach_volume' instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 while it is in vm_state rescued Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'server_id': 'fbcc5ea9-0755-493f-9c67-4a0d0076df04', 'body': {'volumeAttachment': {'volumeId': 'f8d5f9b0-8628-4612-a15f-7d96efb0c40f'}}} Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:10:07.901507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 while it is in vm_state rescued Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:10:07.903011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 while it is in vm_state rescued Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Returning 409 to user: Cannot 'attach_volume' instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 while it is in vm_state rescued {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a5039d48-78dc-4210-b27e-853e47414318 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046553 Sep 08 16:10:07.904158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 141/298] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:10:07 2022] POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 16:10:07.910725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:07.911649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:07.919140 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.919926 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.920666 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.921599 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.922239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.922868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.954334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b8aa8d98-25bb-4c86-b0fa-b14170ab9479 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/action" status: 202 len: 0 microversion: 2.20 time: 0.430903 Sep 08 16:10:07.955065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 158/299] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 16:10:07 2022] POST /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:10:07.967330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:07.968095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:07.975993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.976739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.977171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:07.977874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:07.978322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:07.978741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:08.004303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9f91c58a-699c-4abd-909b-f3a3de2c0abf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/action" status: 202 len: 0 microversion: 2.1 time: 0.097562 Sep 08 16:10:08.005255 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 142/300] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:10:07 2022] POST /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:10:08.027552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:08.028312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:08.034649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:08.035153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:08.035622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:08.036518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:08.037139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:08.037717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:08.132197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:08.140500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:08.141949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:08.143114 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a9dc09d7-08d2-484b-acd1-a71790c41a18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.180632 Sep 08 16:10:08.143713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 159/301] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:07 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:08.173979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:08.182711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6bfaf09d-fdc6-4d6e-9a35-13b08d94e63a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1507 microversion: 2.1 time: 0.168021 Sep 08 16:10:08.183609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 143/302] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:08 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:08.546759 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:08.547560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:08.555776 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:08.556411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:08.557011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:08.557906 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:08.558498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:08.559053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:08.692911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:08.703890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b4c87cf-9b31-4dc1-ba06-15d3c5cbb032 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.162276 Sep 08 16:10:08.704488 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 160/303] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:08 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:09.171204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:09.172210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:09.181153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:09.181800 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:09.182418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:09.183339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:09.183993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:09.184562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:09.206349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:09.206951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:09.213535 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:09.214024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:09.214449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:09.215131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:09.215608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:09.216024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:09.319697 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:09.327948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:09.329399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:09.330557 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-78834d4f-190b-43eb-b4da-467ae3fcef56 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.164716 Sep 08 16:10:09.331120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 144/304] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:09 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:09.356685 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:09.364515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-951171d6-e13d-4745-a6b4-88944604c2ae tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1507 microversion: 2.1 time: 0.162143 Sep 08 16:10:09.365071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 161/305] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:09 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:09.731869 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:09.732891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:09.740101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:09.746410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:09.746896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:09.747317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:09.748032 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:09.748478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:09.748893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.076482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:10.085632 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-96a411c1-e552-4e64-8127-5614d9cd97cf tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.360707 Sep 08 16:10:10.086416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 145/306] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:09 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:10.181408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-963361326", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "networks": [{"uuid": "3f06a316-8f64-4b9b-9a27-1af9727d7cc9"}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:10.191727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:10.192607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:10.248453 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] validate_networks() for [('3f06a316-8f64-4b9b-9a27-1af9727d7cc9', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:10:10.355994 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:10.357177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:10.364766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:10.365261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:10.366073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.366999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:10.367688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:10.368335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.718810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:10.728500 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:10.730735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:10.732037 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-719631f1-a5cc-4a27-b153-53c093d60ab3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.380169 Sep 08 16:10:10.732692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 146/307] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:10 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:10:10.737734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:10.738529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:10.745220 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:10.745879 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:10.746486 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.747852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:10.748527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:10.749160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.816077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:10:10.816505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:10:10.816976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:10:10.817384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:10:10.817794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:10:10.827267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:10.827784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:10.828219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.828975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:10.829426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:10.829855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:10.846982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Getting quotas for project bafdc72abf95401f8784411bc8e55822. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:10:10.851210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Getting quotas for user 2127487c50884141b2776f05e96471fd and project bafdc72abf95401f8784411bc8e55822. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:10:10.864043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:10:10.866656 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:10:10.916092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b7ccdc01-5e7c-4e66-893f-4c1186932a6f tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744163 Sep 08 16:10:10.916744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 162/308] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:10:10.928382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6149b4ae-a48b-4736-a2f8-5a90f3d2d29b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:10.929031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6149b4ae-a48b-4736-a2f8-5a90f3d2d29b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:10.976270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:10.984485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8eee36b9-af91-4c1b-ac11-288a2031f94a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1507 microversion: 2.1 time: 0.250288 Sep 08 16:10:10.994547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6149b4ae-a48b-4736-a2f8-5a90f3d2d29b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:10.999952 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 147/309] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:10 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:11.002975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6149b4ae-a48b-4736-a2f8-5a90f3d2d29b tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1218 microversion: 2.1 time: 0.078604 Sep 08 16:10:11.004011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 163/310] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:10 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:11.108772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:11.109390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:11.115640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:11.116046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:11.116467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:11.117199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:11.117642 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:11.118055 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:11.254911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:11.262601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-97e3af9b-c841-4535-a645-e0d898731ac2 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.157661 Sep 08 16:10:11.263183 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 148/311] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:11 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:11.763433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:11.764327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:11.772172 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:11.772667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:11.773089 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:11.773775 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:11.774218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:11.774649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:11.778635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:11.905713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:11.914500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:11.916000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:11.917181 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-32b92de3-b555-4937-84d0-60d16eb0c1d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.160558 Sep 08 16:10:11.917748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 164/312] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:11 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:12.008742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:12.009349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:12.016424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.016848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.017256 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.017954 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.018399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.018815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.026118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:12.026719 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:12.033168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.033673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.034124 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.034811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.035235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.035697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.101743 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:12.109319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-964f01d0-42e1-4b36-83d8-e2116bad6977 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1222 microversion: 2.1 time: 0.087067 Sep 08 16:10:12.109924 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 165/313] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:12 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:12.150792 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:12.154285 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:12.159476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0eb55eff-7562-42f1-9c06-782c5decef2e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1507 microversion: 2.1 time: 0.154776 Sep 08 16:10:12.160065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 149/314] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:12 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:12.287039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:12.288013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:12.294898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.295487 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.296218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.297143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.297620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.298097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.442919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:12.452832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f17d6653-7e45-419b-b8f0-2b43eae2fc45 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.169664 Sep 08 16:10:12.461552 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 166/315] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:12 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:12.944498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:12.947925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:12.966608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.967212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.967670 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:12.968440 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:12.968889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:12.969369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.136795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:13.137300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:13.149127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:13.149985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:13.150573 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:13.151046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.152019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:13.152670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:13.153606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.158937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:13.160420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:13.161586 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-91f0396b-8427-44d6-8815-5f0d2577a8ad tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.222238 Sep 08 16:10:13.162475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 150/316] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:12 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:13.192457 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:13.194992 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:13.208166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:13.208753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:13.209307 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.210172 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:13.211907 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:13.212352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.239145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:13.252129 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-52e2d3e1-75ed-42ae-990b-850b9d9546c0 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1222 microversion: 2.1 time: 0.115619 Sep 08 16:10:13.257362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 167/317] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:13 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:13.351466 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:13.360628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-55edbf97-6f02-4f12-ab4a-7a24209640a2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1507 microversion: 2.1 time: 0.180779 Sep 08 16:10:13.375938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 151/318] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:13 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:13.476153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:13.476787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:13.484255 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:13.485081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:13.485816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.486842 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:13.487516 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:13.487991 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:13.637617 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:13.645451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b283a20c-c743-4787-a50c-10ab41e41761 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.173033 Sep 08 16:10:13.645938 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 168/319] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:13 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:14.192839 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:14.193974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:14.203020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.203682 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.205727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.206850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.207290 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.207732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.274730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:14.275982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:14.282810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.283508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.283942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.284642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.285094 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.285510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.385725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:14.391736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:14.406718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-14312779-6fbb-482f-a054-ddbc13f9170a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1270 microversion: 2.1 time: 0.136122 Sep 08 16:10:14.408678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:14.410402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:14.411727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4f8689d4-2684-4ca5-9b74-bbe64054d57a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.224509 Sep 08 16:10:14.412515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 169/320] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:14 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:14.417977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 152/321] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:14 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:14.419066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:14.419933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:14.426345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.427053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.427725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.428747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.429442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.430072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.641369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:14.650665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-af37f1b6-2caf-46ee-8d20-ea816e92a341 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1513 microversion: 2.1 time: 0.236295 Sep 08 16:10:14.651790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 170/322] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:14 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:14.669780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:14.670639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:14.677690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.678560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.679192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.680223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:14.680823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:14.681383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:14.876265 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:14.885082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d2e40e3d-8936-4d95-8f02-d266d28c5422 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.219656 Sep 08 16:10:14.886178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 153/323] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:14 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:15.298059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-5d9a7f1f-2740-41d5-a1e6-03bbe0b6d27f req-1ad2e08d-9442-482d-9363-a22a86ffe5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd554b25-6522-4017-9629-9ed119f193b6", "name": "network-vif-plugged", "status": "completed", "tag": "f80b8ad7-51fa-4781-bcb2-e3cf0801f0fe"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:15.309498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5d9a7f1f-2740-41d5-a1e6-03bbe0b6d27f req-1ad2e08d-9442-482d-9363-a22a86ffe5f6 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.309969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5d9a7f1f-2740-41d5-a1e6-03bbe0b6d27f req-1ad2e08d-9442-482d-9363-a22a86ffe5f6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.310555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5d9a7f1f-2740-41d5-a1e6-03bbe0b6d27f req-1ad2e08d-9442-482d-9363-a22a86ffe5f6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:15.325665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-5d9a7f1f-2740-41d5-a1e6-03bbe0b6d27f req-1ad2e08d-9442-482d-9363-a22a86ffe5f6 service nova] Creating event network-vif-plugged:f80b8ad7-51fa-4781-bcb2-e3cf0801f0fe for instance fd554b25-6522-4017-9629-9ed119f193b6 on hv-cinder-85625 Sep 08 16:10:15.331595 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-5d9a7f1f-2740-41d5-a1e6-03bbe0b6d27f req-1ad2e08d-9442-482d-9363-a22a86ffe5f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037269 Sep 08 16:10:15.332708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 171/324] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:15.434983 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:15.435769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:15.448656 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.449223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.449657 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:15.451552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.452678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.454839 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:15.464002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:15.466849 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:15.480875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.482015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.483415 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:15.484483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.487097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.487805 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:15.554282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:15.563033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ac4cb469-0213-4468-8749-c81c5f74d0f5 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1276 microversion: 2.1 time: 0.132483 Sep 08 16:10:15.565904 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 154/325] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:15 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:15.738147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:15.760444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:15.763023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:15.764530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a3e573c5-e40a-428b-816f-eb5b1538a80c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.329959 Sep 08 16:10:15.765668 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 172/326] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:15 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:15.913011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:15.913718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:15.919663 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.920354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.920990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:15.921679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:15.922351 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:15.923672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:16.086057 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:16.094696 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cd53633a-4ded-411f-8d11-84ca9c4b14bc tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.185401 Sep 08 16:10:16.095287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 155/327] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:15 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:16.252416 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9a5fd1a5-0bc5-4ea5-80c5-101895cd580c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'create', calling method: .version_select at 0x7f88602843a0>, body: {"keypair": {"name": "tempest-keypair-1104383644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEK9199akaqoD/ITTv+11kLdV4zJbVCYMT+bLMuuKgv3OOfZXSTjYN/2HuDdyCeLdhfplmvYh8XRNbQDenns0bmN0aGzZuHM3nOiMOdiDDZhIc2hs8bkh5RQ2xBoV/MEA=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:16.278592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-9a5fd1a5-0bc5-4ea5-80c5-101895cd580c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for project 73c9cf0f579144eb80c090456d363a05. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:10:16.283958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-9a5fd1a5-0bc5-4ea5-80c5-101895cd580c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for user 18375266a64348df879a9eec53bfcbf9 and project 73c9cf0f579144eb80c090456d363a05. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:10:16.296013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:16.322877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9a5fd1a5-0bc5-4ea5-80c5-101895cd580c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077176 Sep 08 16:10:16.325473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 173/328] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:10:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:16.590861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:16.591692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:16.598680 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:16.599314 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:16.599875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:16.600997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:16.601584 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:16.602068 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:16.795216 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:16.796117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:16.812152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:16.813123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:16.813710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:16.814614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:16.815592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:16.816204 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:16.946266 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:16.960029 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-70d6337c-94cd-4c57-8e7c-a6c9cbbed59e tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.374747 Sep 08 16:10:16.961336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 156/329] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:16 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:16.968157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ab4c1120-ee0a-4fa0-84ed-6f9dd3bf6fa9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: .version_select at 0x7f88602b79d0>, body: {"keypair": {"name": "tempest-keypair-1218296597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqU5eNzVdu4Fsf7KhbltOmRAU/XsCLGaVmTnvKgbDm33pQMcqMu/NyHi1P9Tc8fg7Y2WVWpvd8QTM+Yy2Fi2a7/jqaX0j5ITxB9/WFVZoUA1hfGDGFEAKdTywqskTVDWw=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:16.992258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-ab4c1120-ee0a-4fa0-84ed-6f9dd3bf6fa9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:10:16.997119 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-ab4c1120-ee0a-4fa0-84ed-6f9dd3bf6fa9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:10:17.051122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ab4c1120-ee0a-4fa0-84ed-6f9dd3bf6fa9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088140 Sep 08 16:10:17.059381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 157/330] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:10:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:17.119543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:17.120188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:17.130808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:17.134080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:17.134477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:17.135226 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:17.136902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:17.139053 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:17.481482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:17.498306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:17.501917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:17.503985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bc6e77d8-be62-4d6b-8ecb-8504c4900df8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.713467 Sep 08 16:10:17.527139 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 174/331] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:16 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:17.604893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:17.614525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3d6eb2ec-8aac-47a4-af20-16aab86f0727 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1314 microversion: 2.1 time: 0.500596 Sep 08 16:10:17.629209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 158/332] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:17 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:17.984162 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:17.985331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:17.994239 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:17.995090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:17.995759 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:17.996650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:17.997414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:17.998584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:18.190518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-f57d5064-cf20-470b-b723-77ce997dfbe1 req-f9e2be39-b114-4fb6-89f1-abcedc386af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f", "tag": "d3f14c71-ffb0-48ef-8111-952d43ed0de6"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:18.210383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-f57d5064-cf20-470b-b723-77ce997dfbe1 req-f9e2be39-b114-4fb6-89f1-abcedc386af5 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:18.211482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-f57d5064-cf20-470b-b723-77ce997dfbe1 req-f9e2be39-b114-4fb6-89f1-abcedc386af5 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:18.212075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-f57d5064-cf20-470b-b723-77ce997dfbe1 req-f9e2be39-b114-4fb6-89f1-abcedc386af5 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:18.239085 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-f57d5064-cf20-470b-b723-77ce997dfbe1 req-f9e2be39-b114-4fb6-89f1-abcedc386af5 service nova] Creating event network-changed:d3f14c71-ffb0-48ef-8111-952d43ed0de6 for instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f on hv-cinder-85625 Sep 08 16:10:18.258609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-f57d5064-cf20-470b-b723-77ce997dfbe1 req-f9e2be39-b114-4fb6-89f1-abcedc386af5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071254 Sep 08 16:10:18.259303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 159/333] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:18.445658 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:18.476109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e25bf301-b4a6-4bcb-be09-fabcbbdf5ac7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.495396 Sep 08 16:10:18.480042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 175/334] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:17 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:18.537977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:18.538723 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:18.554740 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:18.555227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:18.558012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:18.558805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:18.559269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:18.559725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:18.642021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:18.643883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:18.654188 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:18.655056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:18.655799 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:18.657076 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:18.657868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:18.658741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:18.895958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:18.911756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:18.914280 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:18.915880 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-17dbaade-9a6c-4431-8bdf-952b0145f392 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.382720 Sep 08 16:10:18.917823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 160/335] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:18 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:18.945270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:18.954506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-16a05982-b2f6-4a75-a18e-945c020bc924 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1464 microversion: 2.1 time: 0.318111 Sep 08 16:10:18.968742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 176/336] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:18 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:19.007930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:19.008424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:19.024803 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.025659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.027352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.029232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.030087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.030753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.068616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:10:19.182476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-15e0a6ce-fa6a-42c2-85c4-6fbe3c19b9d7 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 204 len: 0 microversion: 2.1 time: 0.179086 Sep 08 16:10:19.192515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 161/337] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:10:19 2022] DELETE /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:10:19.200949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:19.201563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:19.208265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.208754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.209327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.209877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.210333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.210758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.518036 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:19.518762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:19.526307 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.526873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.527438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.528270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.528732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.529153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.640479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:19.653598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ea81970b-26b2-4677-8bfd-429905ee9c16 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1470 microversion: 2.1 time: 0.453564 Sep 08 16:10:19.654946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 177/338] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:19 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1470 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:19.829353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:19.841518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f2d58d57-8409-4a80-a2f6-67382c71f99a tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.338919 Sep 08 16:10:19.842970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 162/339] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:19 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:19.947229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:19.948878 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:19.964939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.974711 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.974983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:19.975904 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:19.976510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:19.976966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:20.122614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1796187151", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "260167e2-5383-42f8-9445-7b6fc1d605d2"}], "security_groups": [{"name": "tempest-securitygroup--1163813634"}], "key_name": "tempest-keypair-1104383644", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:20.291050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] validate_networks() for [('260167e2-5383-42f8-9445-7b6fc1d605d2', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:10:20.551332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:20.560713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:20.562746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:20.564099 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-544c3a8d-77ff-4a64-839e-a9a25b726ad3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.625781 Sep 08 16:10:20.565242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 178/340] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:19 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:20.688868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:20.689486 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:20.702933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:20.703761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:20.704202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:20.704918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:20.710219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:20.710910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:20.792987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:10:20.794062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:10:20.794729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:10:20.796283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:10:20.796878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:10:20.808227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:20.809076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:20.809679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:20.810579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:20.811222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:20.811845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:20.832315 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for project 73c9cf0f579144eb80c090456d363a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:10:20.837570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:20.843351 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Getting quotas for user 18375266a64348df879a9eec53bfcbf9 and project 73c9cf0f579144eb80c090456d363a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:10:20.858452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:10:20.864695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:10:20.916599 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b515a548-a49e-4aef-8ce4-7ac5a9768232 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.798057 Sep 08 16:10:20.923542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 163/341] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:10:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:10:20.923542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1961411926", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a88764e-b620-4723-a684-b37f114bda88"}], "security_groups": [{"name": "tempest-securitygroup--79706071"}], "key_name": "tempest-keypair-1218296597", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:20.958502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:20.968917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-51728cec-f7a5-4c9f-9855-43cc183959f9 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1470 microversion: 2.1 time: 0.284764 Sep 08 16:10:20.969354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 179/342] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:20 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:20.988742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:20.989551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:20.996630 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:20.997116 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:20.997713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:20.998749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:20.999378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:20.999833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:21.074316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] validate_networks() for [('2a88764e-b620-4723-a684-b37f114bda88', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:10:21.330297 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:21.351349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:21.360685 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-705b2706-2b25-4e70-ba83-134f536a1a9c tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.390265 Sep 08 16:10:21.371502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 180/343] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:20 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:21.371502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f8310c75-a823-40c7-bde9-3112b492777f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:21.371502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f8310c75-a823-40c7-bde9-3112b492777f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:21.459892 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f8310c75-a823-40c7-bde9-3112b492777f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:21.468042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f8310c75-a823-40c7-bde9-3112b492777f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1246 microversion: 2.1 time: 0.101746 Sep 08 16:10:21.470812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 181/344] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:21 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:21.591404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:21.592168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:21.608139 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:21.608857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:21.609448 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:21.610375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:21.610978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:21.611591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:21.635829 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:10:21.636597 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:10:21.639497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:10:21.641577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:10:21.641999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:10:21.651141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:21.651838 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:21.652437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:21.653797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:21.654290 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:21.654769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:21.683031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:10:21.687119 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:10:21.699842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:10:21.702242 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:10:21.767039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e48be8e0-2278-4d59-bf3e-754783b8c0ae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.848396 Sep 08 16:10:21.774504 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 164/345] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:10:20 2022] POST /compute/v2.1/servers => generated 400 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:10:21.779909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-efe10ee0-caa7-4e41-9d81-521d5f77707f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:21.780749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-efe10ee0-caa7-4e41-9d81-521d5f77707f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:21.806159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:21.828831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:21.831484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:21.835832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7e49a833-7718-4a9e-b1e2-7d32fc5354f1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.249076 Sep 08 16:10:21.836440 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 182/346] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:21 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:21.866569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-efe10ee0-caa7-4e41-9d81-521d5f77707f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:21.873600 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-efe10ee0-caa7-4e41-9d81-521d5f77707f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1242 microversion: 2.1 time: 0.097540 Sep 08 16:10:21.874679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 165/347] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:21 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:21.994793 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:21.995428 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:22.006129 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.006855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.008269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.008988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.009443 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.009868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.056008 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:22.291256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:22.302038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0fa76df3-67c1-4900-9d2e-a6ce10aa1cad tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1470 microversion: 2.1 time: 0.311816 Sep 08 16:10:22.318712 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 183/348] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:21 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:22.388104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:22.389623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:22.402327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.404438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.404939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.408559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.409102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.409609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.493374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:22.494261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:22.513535 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.514063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.514500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.515870 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.520709 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.521371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.626907 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:22.636839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1fef02f0-3147-492d-babe-66fcda82b5dc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1242 microversion: 2.1 time: 0.147333 Sep 08 16:10:22.637965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 184/349] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:22 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:22.862931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:22.874755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:22.894746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.895159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.895628 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:22.898242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:22.898700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:22.899138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.211398 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:23.228091 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:23.230450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:23.232117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a883dc5e-aaf8-4041-b794-6bf183b88894 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1743 microversion: 2.20 time: 0.373805 Sep 08 16:10:23.233269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 185/350] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:22 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1743 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:23.243768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:23.245301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:23.264322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:23.267295 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:23.267924 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.272403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:23.272899 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:23.273472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.377668 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:23.388650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0a9d1932-7375-4612-af9d-b35501240704 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1238 microversion: 2.1 time: 0.154105 Sep 08 16:10:23.389805 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 186/351] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:23 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1238 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:23.400356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:23.400976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:23.404678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:23.409822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:23.410508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:23.411170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.412363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:23.412970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:23.414040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.417320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-81eb2427-c2a7-49f2-b8b7-be89ef421ff2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 1.033598 Sep 08 16:10:23.421070 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 166/352] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:22 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:23.676565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:23.677480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:23.693885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:23.694840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:23.697870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.699023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:23.700635 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:23.702483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:23.716604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:23.731011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-46daf3f4-1998-41e6-b6b9-2c542592a882 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1470 microversion: 2.1 time: 0.337751 Sep 08 16:10:23.732959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 187/353] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:23 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:24.077367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:24.086720 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-87b7f6cd-8f56-48ec-a52a-829279eadd3c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1306 microversion: 2.1 time: 0.424057 Sep 08 16:10:24.106026 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 167/354] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:23 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1306 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:24.263778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:24.264393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:24.276374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.276872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.278610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.281735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.282419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.284244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.417260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:24.418007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:24.429912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.430376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.430825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.432719 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.433473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.434081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.470555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:24.482646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:24.484726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:24.486722 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-850df1ea-4078-4af9-8727-bef336648718 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1743 microversion: 2.20 time: 0.228066 Sep 08 16:10:24.487817 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 188/355] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:24 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1743 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:24.495395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:24.496248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:24.503888 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.504603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.505843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.506771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.507957 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.508543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.618013 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:24.622491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:24.628291 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cc9f846f-ce39-438b-a1f6-f5ee7695116e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1294 microversion: 2.1 time: 0.215288 Sep 08 16:10:24.647869 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 168/356] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:24 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1294 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:24.758846 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:24.759477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:24.777748 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.778566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.780375 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.781333 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:24.783921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:24.784449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:24.784796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:24.799618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a561c06b-9d93-446b-a8d1-93a8baa6d11d tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.308636 Sep 08 16:10:24.800445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 189/357] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:24 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:25.074967 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-6d1f2155-695b-4570-a21a-58d34fdd174e req-36a3f0c4-19a5-45dd-8ac3-065fc3fa7f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd554b25-6522-4017-9629-9ed119f193b6", "name": "network-vif-deleted", "tag": "f80b8ad7-51fa-4781-bcb2-e3cf0801f0fe"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:25.102330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d1f2155-695b-4570-a21a-58d34fdd174e req-36a3f0c4-19a5-45dd-8ac3-065fc3fa7f9a service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.103348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d1f2155-695b-4570-a21a-58d34fdd174e req-36a3f0c4-19a5-45dd-8ac3-065fc3fa7f9a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.106369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d1f2155-695b-4570-a21a-58d34fdd174e req-36a3f0c4-19a5-45dd-8ac3-065fc3fa7f9a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.111777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:25.127410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6b391a54-4bb8-4b80-a898-b6044ff92072 tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1428 microversion: 2.1 time: 0.372863 Sep 08 16:10:25.133309 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 169/358] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:24 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1428 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:25.152084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:25.157356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:25.163393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-6d1f2155-695b-4570-a21a-58d34fdd174e req-36a3f0c4-19a5-45dd-8ac3-065fc3fa7f9a service nova] Creating event network-vif-deleted:f80b8ad7-51fa-4781-bcb2-e3cf0801f0fe for instance fd554b25-6522-4017-9629-9ed119f193b6 on hv-cinder-85625 Sep 08 16:10:25.187216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.190883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-6d1f2155-695b-4570-a21a-58d34fdd174e req-36a3f0c4-19a5-45dd-8ac3-065fc3fa7f9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122125 Sep 08 16:10:25.191401 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.192155 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.197437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.198783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 190/359] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:10:25.199491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.200322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.436539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:25.448216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1b17bd3b-9b42-4254-bad3-e9d8caea4761 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1304 microversion: 2.1 time: 0.311864 Sep 08 16:10:25.452587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 170/360] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:25 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1304 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:25.520638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:25.522257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:25.536207 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.546739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.549571 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.550551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.551230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.551913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.654671 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:25.655821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:25.666444 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.669866 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.671165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.672690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.676968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.680071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.830084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:25.844262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:25.849347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:25.850809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-77e4262e-9061-4db4-997a-0bb5725fed0c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.336872 Sep 08 16:10:25.853283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 191/361] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:25 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:25.865828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:25.866611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:25.884878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:25.886078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.889846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.891351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:25.893680 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:25.894586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:25.895823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5bd79c6a-d5ab-4234-a042-830474ef8e16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1300 microversion: 2.1 time: 0.245182 Sep 08 16:10:25.896586 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 171/362] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:25 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:25.902783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.154583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:26.155770 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:26.162706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.163472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.164113 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.165019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.165862 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.166516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.186457 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:26.194769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d2c44074-aba2-48a2-84ae-cbe03f9abe09 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.340204 Sep 08 16:10:26.203378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.204225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.204870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.205619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lazy-loading 'fault' on Instance uuid fd554b25-6522-4017-9629-9ed119f193b6 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:10:26.209042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 192/363] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:25 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:26.301146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f66138a7d2594933b09e1fcc7a4c2f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a3e27d765147298f6d421fc614f77f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:26.339878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eda45e84-c4fe-4653-97ed-fa6b8e117d8c tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 200 len: 1304 microversion: 2.1 time: 0.189064 Sep 08 16:10:26.342163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 172/364] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:26 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 1304 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:26.478986 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:26.479642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:26.490968 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.493342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.493874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.494734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.495209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.495671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.841209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:26.852296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-80780dec-ff4e-4872-8e60-4e861f7a0bc0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.377890 Sep 08 16:10:26.857857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 193/365] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:26 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:26.888221 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:26.889127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:26.904602 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.905458 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.906015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.906905 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.908507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.913004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.923305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:26.924181 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:26.943846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.944671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.946684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:26.949397 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:26.952945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:26.960093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.322106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:27.331277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:27.332764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:27.339588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-29b5aba9-8d39-4b4e-8eec-325ba9f0777b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.451270 Sep 08 16:10:27.343989 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 173/366] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:26 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:27.351871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:27.355325 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:27.372667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.375974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.376633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.377519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.379431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.381438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.602811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:27.611935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cf8ad110-cc6b-4505-b1a3-4fed8b8b4f88 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.695278 Sep 08 16:10:27.612534 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 194/367] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:26 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:27.625998 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:27.626629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] [instance: fd554b25-6522-4017-9629-9ed119f193b6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:27.639212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.639740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.640176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.640950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.641406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.641829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.680715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] HTTP exception thrown: Instance fd554b25-6522-4017-9629-9ed119f193b6 could not be found. Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Request method failure captured: Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 HTTP/1.1 Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhPVnJy__RfWBEnRvMEJ0Sg0YS889ZKMdnzp9Gh808uqZn2y5h1CIeCP7CwMNo4mrA5vtaHsoB0NlcXEA7KJH3loDZKZo_xzkbvnLPhawufBnoV-7V2Vadl5Fy2-v5eI-i44mUPo1q1lKyAoTGIKxyDLkWnTnA6voizMMk0Io5t_2v4 Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 19a3e27d765147298f6d421fc614f77f Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesNegativeTest-148147923 Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:10:27.688177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19a3e27d765147298f6d421fc614f77f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19a3e27d765147298f6d421fc614f77f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19a3e27d765147298f6d421fc614f77f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19a3e27d765147298f6d421fc614f77f"}]}] Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesNegativeTest-148147923 Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 19a3e27d765147298f6d421fc614f77f Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesNegativeTest-148147923 Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesNegativeTest-148147923-project Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: f66138a7d2594933b09e1fcc7a4c2f1a Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesNegativeTest-148147923-project Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance fd554b25-6522-4017-9629-9ed119f193b6 could not be found. Sep 08 16:10:27.690018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'fd554b25-6522-4017-9629-9ed119f193b6'} Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd554b25-6522-4017-9629-9ed119f193b6 could not be found. Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:10:27.690748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd554b25-6522-4017-9629-9ed119f193b6 could not be found. Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd554b25-6522-4017-9629-9ed119f193b6 could not be found. Sep 08 16:10:27.692190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:10:27.695346 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:27.699007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] Returning 404 to user: Instance fd554b25-6522-4017-9629-9ed119f193b6 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:10:27.701824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0fbcd8c7-d60d-4755-8908-cfc84db7289f tempest-VolumesNegativeTest-148147923 tempest-VolumesNegativeTest-148147923-project] 10.222.0.27 "GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6" status: 404 len: 111 microversion: 2.1 time: 0.086736 Sep 08 16:10:27.702650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4338e5e1-9410-4d4e-852e-de24db034ebc tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.353984 Sep 08 16:10:27.707008 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 195/368] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:27 2022] GET /compute/v2.1/servers/fd554b25-6522-4017-9629-9ed119f193b6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:10:27.713904 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 174/369] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:27 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:27.720067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-287c5292-c3b7-4b42-b2d2-049f9bbd4714 req-ea0df816-6d8e-44e9-95c1-c966bd480bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23052556-fe21-4d01-936b-c88007a44203", "tag": "73501033-f27c-4891-8146-0beb36569265"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:27.735240 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-287c5292-c3b7-4b42-b2d2-049f9bbd4714 req-ea0df816-6d8e-44e9-95c1-c966bd480bfb service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.736142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-287c5292-c3b7-4b42-b2d2-049f9bbd4714 req-ea0df816-6d8e-44e9-95c1-c966bd480bfb service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.736758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-287c5292-c3b7-4b42-b2d2-049f9bbd4714 req-ea0df816-6d8e-44e9-95c1-c966bd480bfb service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.769132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-287c5292-c3b7-4b42-b2d2-049f9bbd4714 req-ea0df816-6d8e-44e9-95c1-c966bd480bfb service nova] Creating event network-changed:73501033-f27c-4891-8146-0beb36569265 for instance 23052556-fe21-4d01-936b-c88007a44203 on hv-cinder-85625 Sep 08 16:10:27.782195 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-287c5292-c3b7-4b42-b2d2-049f9bbd4714 req-ea0df816-6d8e-44e9-95c1-c966bd480bfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070838 Sep 08 16:10:27.783146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 196/370] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:27.792074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-b0620f32-e9a4-43b3-aecc-c68fbd324034 req-d465a531-bfc7-4a2e-ad08-6c4121496b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "name": "network-vif-plugged", "status": "completed", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:27.815816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b0620f32-e9a4-43b3-aecc-c68fbd324034 req-d465a531-bfc7-4a2e-ad08-6c4121496b82 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.816750 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b0620f32-e9a4-43b3-aecc-c68fbd324034 req-d465a531-bfc7-4a2e-ad08-6c4121496b82 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.817542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b0620f32-e9a4-43b3-aecc-c68fbd324034 req-d465a531-bfc7-4a2e-ad08-6c4121496b82 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.832596 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-b0620f32-e9a4-43b3-aecc-c68fbd324034 req-d465a531-bfc7-4a2e-ad08-6c4121496b82 service nova] Creating event network-vif-plugged:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:10:27.838660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-b0620f32-e9a4-43b3-aecc-c68fbd324034 req-d465a531-bfc7-4a2e-ad08-6c4121496b82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050000 Sep 08 16:10:27.839896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 175/371] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:27.878473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:27.880743 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:27.890245 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.896130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.896915 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:27.897879 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:27.899047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:27.902438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:28.369275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:28.369962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:28.382658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:28.383228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:28.383872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:28.384777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:28.388033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:28.388673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:28.466108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:28.484994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ec731fe8-22e1-4ccb-805b-02a45b898bc8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.611949 Sep 08 16:10:28.506807 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 197/372] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:27 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:28.635197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:28.636203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:28.642976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:28.643827 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:28.644462 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:28.645530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:28.646188 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:28.646827 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:28.918090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:28.932332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-052319f7-ce16-472e-b652-90186a7aec00 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.300871 Sep 08 16:10:28.933201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 198/373] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:28 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:28.938331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:28.939351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:28.948694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:28.949562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:28.950357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:28.951282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:28.952069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:28.953147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:29.161927 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:29.177854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e615ed58-2a89-4989-a5d6-21ae69d59d89 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.243205 Sep 08 16:10:29.185354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 199/374] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:28 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:29.264679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:29.273473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:29.281369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:29.282849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-07ccf8fe-101b-4b22-962c-d09887a17816 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.918432 Sep 08 16:10:29.283598 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 176/375] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:28 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:10:29.521555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:29.522399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:29.529467 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:29.537700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:29.539982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:29.539982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:29.543327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:29.543572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:29.616170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-4e666e0e-8c99-4d38-8942-68759fe8fc97 req-93dc30ae-8b2a-4b8b-8306-a19961a685a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43a6d26-3e4a-4fde-8461-ad70b4e96a46", "tag": "a2422c6e-ed88-4508-ab49-226147c59fb9"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:29.639149 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e666e0e-8c99-4d38-8942-68759fe8fc97 req-93dc30ae-8b2a-4b8b-8306-a19961a685a0 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:29.643201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e666e0e-8c99-4d38-8942-68759fe8fc97 req-93dc30ae-8b2a-4b8b-8306-a19961a685a0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:29.644329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-4e666e0e-8c99-4d38-8942-68759fe8fc97 req-93dc30ae-8b2a-4b8b-8306-a19961a685a0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:29.698569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-4e666e0e-8c99-4d38-8942-68759fe8fc97 req-93dc30ae-8b2a-4b8b-8306-a19961a685a0 service nova] Creating event network-changed:a2422c6e-ed88-4508-ab49-226147c59fb9 for instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 on hv-cinder-85625 Sep 08 16:10:29.704623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-4e666e0e-8c99-4d38-8942-68759fe8fc97 req-93dc30ae-8b2a-4b8b-8306-a19961a685a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092396 Sep 08 16:10:29.709240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 177/376] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:29.926659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-9e1f3a1b-59be-4648-bd43-3d2579fe58d5 req-b246262f-70be-4d1c-9deb-3d052af300ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "d3f14c71-ffb0-48ef-8111-952d43ed0de6"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:29.949831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:29.955934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9e1f3a1b-59be-4648-bd43-3d2579fe58d5 req-b246262f-70be-4d1c-9deb-3d052af300ba service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:29.956416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9e1f3a1b-59be-4648-bd43-3d2579fe58d5 req-b246262f-70be-4d1c-9deb-3d052af300ba service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:29.956835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9e1f3a1b-59be-4648-bd43-3d2579fe58d5 req-b246262f-70be-4d1c-9deb-3d052af300ba service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:29.962341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c2f60ef5-af6f-4843-a59d-b246276da200 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.441394 Sep 08 16:10:29.978114 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 200/377] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:29 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:29.988225 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:29.991181 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:29.998625 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-9e1f3a1b-59be-4648-bd43-3d2579fe58d5 req-b246262f-70be-4d1c-9deb-3d052af300ba service nova] Creating event network-vif-plugged:d3f14c71-ffb0-48ef-8111-952d43ed0de6 for instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f on hv-cinder-85625 Sep 08 16:10:30.004137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:30.004882 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:30.005317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:30.006015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:30.006465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:30.010380 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-9e1f3a1b-59be-4648-bd43-3d2579fe58d5 req-b246262f-70be-4d1c-9deb-3d052af300ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087633 Sep 08 16:10:30.011042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:30.011769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 178/378] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:10:30.210061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:30.210775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:30.222717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:30.223204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:30.223666 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:30.224376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:30.224826 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:30.225252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:30.426088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:30.435187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-17d86e25-7dd1-400d-bba5-a63a4055ada1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.455908 Sep 08 16:10:30.438747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 201/379] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:29 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:30.454386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:30.458792 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:30.473999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:30.474498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:30.474955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:30.479269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:30.479839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:30.480278 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:30.530968 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:30.769272 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:30.778203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:30.779649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:30.780825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-24e98ea1-7b05-415d-bf7c-00fc7aee9f9a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.336525 Sep 08 16:10:30.781486 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 202/380] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:30 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:30.802790 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:30.813350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f7286fec-d96f-4db8-8f9e-66db725dbcc3 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.607064 Sep 08 16:10:30.827956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 179/381] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:30 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:30.988758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:30.989360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:31.024929 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:31.027944 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:31.029702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:31.041584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:31.044103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:31.044591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:31.250823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:31.287707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d2f20da2-15bc-4a08-9980-80355e8cc337 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.304511 Sep 08 16:10:31.288815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 203/382] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:30 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:31.460873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:31.461752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:31.476965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:31.477463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:31.477890 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:31.478617 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:31.479247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:31.480091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:31.673156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:31.812337 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:31.813289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:31.825242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=14 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:31.829435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:31.832342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:31.834939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:31.837170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:31.838950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:31.842193 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:31.870554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=18 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:32.093373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:32.106258 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:32.108171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:32.109800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f3343ad0-56d1-4558-b7f1-11ee8bf1ded9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.301413 Sep 08 16:10:32.111012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 204/383] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:31 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:32.116984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:32.117803 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:32.125324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:32.125995 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:32.126576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:32.127804 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:32.128479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:32.129133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:32.202509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:32.214131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e558f7b0-1664-4f28-abb2-b3e87b40017d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.757218 Sep 08 16:10:32.214800 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 180/384] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:31 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:32.314001 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:32.314618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:32.324543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:32.328546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:32.331131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:32.332289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:32.332922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:32.333544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:32.442566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:32.482651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f42b82dc-84b8-433f-a7b5-c7de785074e2 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1318 microversion: 2.1 time: 0.369576 Sep 08 16:10:32.484396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 205/385] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:32 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:32.671603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:32.687717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f86ad73c-fc71-42ad-a0c7-c3685dc5e77b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.377457 Sep 08 16:10:32.698317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 181/386] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:32 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:33.143370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:33.144030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:33.165360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:33.174203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:33.179073 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:33.182631 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:33.183164 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:33.185897 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:33.250961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:33.252247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:33.260525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:33.270539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:33.273932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:33.276206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:33.277000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:33.277667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:33.450446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:33.461338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:33.468187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:33.469344 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c8f5c0de-4856-4952-8363-3f7600862482 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.331821 Sep 08 16:10:33.491408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 206/387] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:33 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:33.560786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:33.586956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9d734582-4a65-46c3-a766-ae3b49381223 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.340378 Sep 08 16:10:33.591552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 182/388] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:33 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:33.609324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:33.609685 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:33.626698 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:33.627297 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:33.627649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:33.628360 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:33.628826 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:33.637711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:33.899476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b219dd0c-9523-4769-9466-e1500010442d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Action: 'create', calling method: .version_select at 0x7f886029cb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1361964657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoryMRcBITD2Zm3rjIv4PDBrB99105Vgbf33mxLQd4jaidMLSMjwnEXBUwDRTUIthdx7rdqiM8vWCCUnu6mvwqLg5N6+u2qVl5zkn0yLgG5kgLqKl1rOR1f4PdmX57jpQ=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:33.934260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-b219dd0c-9523-4769-9466-e1500010442d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:10:33.939999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-b219dd0c-9523-4769-9466-e1500010442d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for user 77aeaed3d55945e49b0eb6e3c0519294 and project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:10:33.984349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b219dd0c-9523-4769-9466-e1500010442d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.491572 Sep 08 16:10:33.984872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 207/389] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:10:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:33.991087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-6170cb62-efbc-4bb0-b9d4-bb6953468b2c req-1ede18e9-45b2-4936-90d5-f684279311f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23052556-fe21-4d01-936b-c88007a44203", "name": "network-vif-plugged", "status": "completed", "tag": "73501033-f27c-4891-8146-0beb36569265"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:34.006024 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6170cb62-efbc-4bb0-b9d4-bb6953468b2c req-1ede18e9-45b2-4936-90d5-f684279311f3 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.006664 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6170cb62-efbc-4bb0-b9d4-bb6953468b2c req-1ede18e9-45b2-4936-90d5-f684279311f3 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.007184 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6170cb62-efbc-4bb0-b9d4-bb6953468b2c req-1ede18e9-45b2-4936-90d5-f684279311f3 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.028067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-6170cb62-efbc-4bb0-b9d4-bb6953468b2c req-1ede18e9-45b2-4936-90d5-f684279311f3 service nova] Creating event network-vif-plugged:73501033-f27c-4891-8146-0beb36569265 for instance 23052556-fe21-4d01-936b-c88007a44203 on hv-cinder-85625 Sep 08 16:10:34.038192 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-6170cb62-efbc-4bb0-b9d4-bb6953468b2c req-1ede18e9-45b2-4936-90d5-f684279311f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051872 Sep 08 16:10:34.042629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 208/390] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:34.069853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:34.071526 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:34.080998 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.083051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.083912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.084919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.085626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.086249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.113232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:34.123969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ef71f131-4b7c-4efa-89e0-295586773936 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1507 microversion: 2.1 time: 0.531203 Sep 08 16:10:34.125341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 183/391] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:33 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1507 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:34.153219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25f90c7a-621a-4337-ae2a-0dea4f62791f", "device": "/dev/sdb"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:34.156278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:34.190405 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.191125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.192110 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.194070 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.195977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.198739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.540908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:34.551629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-151a45db-47a7-4f5c-8091-2b7846b1713f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.505506 Sep 08 16:10:34.555438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 209/392] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:34 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:34.561810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:34.563045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:34.578694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.591480 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.595090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.596169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.596798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.601111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.708393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-34d45415-d462-4c8d-bc0b-7a2eacbd9e24 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "POST /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557600 Sep 08 16:10:34.713145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 184/393] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:10:34 2022] POST /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:34.768372 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:34.769013 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:34.851491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.854269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.856288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.857461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:34.858861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:34.861328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:34.987192 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:34.997447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:34.998883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:35.015948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5e0e4a5f-3458-4763-a899-c099c5ff2bc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.457932 Sep 08 16:10:35.027633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 210/394] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:34 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:35.357360 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:35.371422 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:35.378507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ea3a496c-b6a6-4801-a20a-faaefa9e0bb1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.664079 Sep 08 16:10:35.381587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 185/395] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:34 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:35.602086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:35.602859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:35.614065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:35.615335 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:35.615994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:35.617431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:35.618654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:35.619484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:36.041947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:36.042556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:36.051948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:36.060023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:36.060902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:36.062145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:36.062885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:36.063559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:36.224074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:36.238459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1e732799-f68a-4eb0-babb-b47ebf5f8278 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.659165 Sep 08 16:10:36.240289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 211/396] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:35 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:36.384103 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:36.397282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:36.405112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:36.406850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6fa8288e-5e4c-4612-9510-b74c23bb1c64 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.368852 Sep 08 16:10:36.407639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:36.408332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:36.408924 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 186/397] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:36 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:36.418394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:36.418921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:36.419498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:36.421481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:36.424451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:36.425200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:36.675347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:36.701016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e57a0826-07be-4ea3-92d8-824e3eec0018 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1366 microversion: 2.1 time: 0.295941 Sep 08 16:10:36.708809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 212/398] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:36 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:37.262111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:37.263594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:37.276553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.277056 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.277494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.281247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.281977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.283400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.452474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:37.453197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:37.461273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.461762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.462187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.462944 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.463394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.463890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.575552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:37.592318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5be52586-9128-4c3e-96e5-c0dc407997ea tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.333410 Sep 08 16:10:37.592946 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 187/399] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:37 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:37.609840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-495b4ed8-a431-46e6-8e3a-257bc26d428d req-62ffc0f0-c477-4d03-87ef-3a5f345467f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43a6d26-3e4a-4fde-8461-ad70b4e96a46", "name": "network-vif-plugged", "status": "completed", "tag": "a2422c6e-ed88-4508-ab49-226147c59fb9"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:37.624064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-495b4ed8-a431-46e6-8e3a-257bc26d428d req-62ffc0f0-c477-4d03-87ef-3a5f345467f3 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.624064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-495b4ed8-a431-46e6-8e3a-257bc26d428d req-62ffc0f0-c477-4d03-87ef-3a5f345467f3 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.624417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-495b4ed8-a431-46e6-8e3a-257bc26d428d req-62ffc0f0-c477-4d03-87ef-3a5f345467f3 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.643926 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-495b4ed8-a431-46e6-8e3a-257bc26d428d req-62ffc0f0-c477-4d03-87ef-3a5f345467f3 service nova] Creating event network-vif-plugged:a2422c6e-ed88-4508-ab49-226147c59fb9 for instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 on hv-cinder-85625 Sep 08 16:10:37.650386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-495b4ed8-a431-46e6-8e3a-257bc26d428d req-62ffc0f0-c477-4d03-87ef-3a5f345467f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056063 Sep 08 16:10:37.650978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 188/400] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:37.715811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:37.733579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:37.734320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:37.745938 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:37.747370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.748051 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.748699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.749399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:37.750010 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:37.751269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3a19a8bd-55c1-4cf9-851c-21c3e5de6087 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.320862 Sep 08 16:10:37.751509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:37.752960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:37.763614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 213/401] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:37 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:38.050020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:38.068608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8e8dcf2d-a49d-41b9-a62b-6539ee95724f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1556 microversion: 2.1 time: 0.339536 Sep 08 16:10:38.069678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 189/402] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:37 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1556 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:10:38.096055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:38.096548 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:38.103207 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:38.103746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:38.104334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:38.105218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:38.105810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:38.108526 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:38.205975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9e6b0701-a6a0-4e52-9a29-19b8bc4ff817 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114088 Sep 08 16:10:38.206574 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 214/403] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:10:38 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:38.616806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:38.618074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:38.627873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:38.628652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:38.629253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:38.630127 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:38.631126 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:38.631883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:38.785043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:38.786293 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:38.798284 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:38.799022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:38.799646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:38.800675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:38.801142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:38.801600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:38.834200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:38.843782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8587320e-346b-4f5d-a451-55f43622cc4c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.231173 Sep 08 16:10:38.844692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 190/404] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:38 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:39.086110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:39.105096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:39.115466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:39.133533 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b36d7b9-1b4b-45e5-913b-f9fc2f4657b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.356600 Sep 08 16:10:39.134155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 215/405] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:38 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:39.482350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-5992bf27-cec3-4166-9b9a-a09e8e3a3388 req-c7783aa5-cd41-49f9-baf4-5c121ecf34f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23052556-fe21-4d01-936b-c88007a44203", "tag": "73501033-f27c-4891-8146-0beb36569265"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:39.504455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-5992bf27-cec3-4166-9b9a-a09e8e3a3388 req-c7783aa5-cd41-49f9-baf4-5c121ecf34f9 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:39.505410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-5992bf27-cec3-4166-9b9a-a09e8e3a3388 req-c7783aa5-cd41-49f9-baf4-5c121ecf34f9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:39.506033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-5992bf27-cec3-4166-9b9a-a09e8e3a3388 req-c7783aa5-cd41-49f9-baf4-5c121ecf34f9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:39.528798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-5992bf27-cec3-4166-9b9a-a09e8e3a3388 req-c7783aa5-cd41-49f9-baf4-5c121ecf34f9 service nova] Creating event network-changed:73501033-f27c-4891-8146-0beb36569265 for instance 23052556-fe21-4d01-936b-c88007a44203 on hv-cinder-85625 Sep 08 16:10:39.541634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-5992bf27-cec3-4166-9b9a-a09e8e3a3388 req-c7783aa5-cd41-49f9-baf4-5c121ecf34f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063142 Sep 08 16:10:39.542685 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 191/406] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:39.870584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:39.872068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:39.876175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:39.881940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:39.882983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:39.883672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:39.884753 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:39.885438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:39.885960 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:40.034432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:40.042407 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-60bf7b5f-6081-4953-afa1-017149a00285 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1372 microversion: 2.1 time: 0.175886 Sep 08 16:10:40.042970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 216/407] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:39 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:40.163271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:40.164763 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:40.172024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:40.172858 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:40.173505 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:40.174461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:40.175119 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:40.175791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:40.345137 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:40.356940 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:40.358650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:40.360192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6faafbd0-039c-4602-8dcb-66b404442e78 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.201419 Sep 08 16:10:40.361303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 192/408] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:40 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:41.068893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:41.069504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:41.081738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:41.082706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:41.083145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:41.084291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:41.084751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:41.085177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:41.242143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:41.252571 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aea3d7ce-3f5a-4221-a826-d1dfda6d8438 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1565 microversion: 2.1 time: 0.188029 Sep 08 16:10:41.253702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 217/409] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:10:41 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:10:41.275725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:41.276305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:41.282979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:41.283499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:41.284126 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:41.284831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:41.285287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:41.285712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:41.374299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-77e76cbf-efb2-453e-9f8b-1f0975a6d8b3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102486 Sep 08 16:10:41.375211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 193/410] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:10:41 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:41.396429 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:41.397041 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:41.437654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:41.438165 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:41.438600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:41.439319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:41.439793 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:41.440214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:41.733036 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:41.746442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:41.747913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:41.756057 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8fc98c4c-3f69-4072-9c40-2cdee33c28d8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.371208 Sep 08 16:10:41.757211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 218/411] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:41 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:42.786445 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:42.787147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:42.791827 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-13df18de-52ee-4d13-af00-0862f49dc0fa req-0d674f13-bd17-4d0b-a393-8003d8708638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43a6d26-3e4a-4fde-8461-ad70b4e96a46", "tag": "a2422c6e-ed88-4508-ab49-226147c59fb9"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:42.797415 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:42.804967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:42.805688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:42.806595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:42.807215 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:42.808001 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:42.822119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13df18de-52ee-4d13-af00-0862f49dc0fa req-0d674f13-bd17-4d0b-a393-8003d8708638 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:42.822119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13df18de-52ee-4d13-af00-0862f49dc0fa req-0d674f13-bd17-4d0b-a393-8003d8708638 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:42.822119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-13df18de-52ee-4d13-af00-0862f49dc0fa req-0d674f13-bd17-4d0b-a393-8003d8708638 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:42.833798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-13df18de-52ee-4d13-af00-0862f49dc0fa req-0d674f13-bd17-4d0b-a393-8003d8708638 service nova] Creating event network-changed:a2422c6e-ed88-4508-ab49-226147c59fb9 for instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 on hv-cinder-85625 Sep 08 16:10:42.839755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-13df18de-52ee-4d13-af00-0862f49dc0fa req-0d674f13-bd17-4d0b-a393-8003d8708638 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051413 Sep 08 16:10:42.840505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 219/412] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:43.140857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:43.158275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:43.162926 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:43.164852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9b5ef54a-3571-446d-beae-a53337a21161 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.384281 Sep 08 16:10:43.173362 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 194/413] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:42 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:44.196317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=4 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:44.200790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:44.201512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:44.208070 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:44.208508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:44.209076 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:44.209760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:44.210209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:44.210629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:44.355884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:44.364451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:44.365896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:44.367035 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9baaeab0-f6e8-4655-8b0f-904734300672 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.172265 Sep 08 16:10:44.367623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 220/414] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:44 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:45.396166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:45.396776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:45.403742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:45.404220 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:45.404648 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:45.405328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:45.405771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:45.406186 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:45.577976 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:45.586397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:45.587864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:45.589017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-19fa6334-216c-4b74-a515-9bec69f36d75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.197499 Sep 08 16:10:45.589544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 195/415] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:45 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:46.614980 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:46.615622 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:46.622766 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:46.623245 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:46.623706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:46.624403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:46.624844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:46.625261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:46.643862 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:46.989542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:46.998629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:47.000251 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:47.001513 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2e4ed427-638d-4ade-af37-080de99a0e19 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1738 microversion: 2.20 time: 0.390808 Sep 08 16:10:47.002087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 221/416] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:46 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:48.029459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:48.030071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:48.037489 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:48.038747 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:48.039203 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:48.039960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:48.040413 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:48.040838 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:48.273031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:48.281134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:48.282593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:48.283790 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3f23b742-9008-46fd-aa5e-fd02a0709558 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1720 microversion: 2.20 time: 0.258747 Sep 08 16:10:48.284508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 196/417] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:48 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:49.320956 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:49.321905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:49.332579 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:49.333109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:49.333658 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:49.334447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:49.334982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:49.335717 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:49.477621 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:49.486221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:49.487704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:49.488880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4a8d7269-061b-40bf-b6c5-a83c2b676d51 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1720 microversion: 2.20 time: 0.175021 Sep 08 16:10:49.489444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 222/418] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:49 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:49.823553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:49.824252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:49.832406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:49.832892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:49.833330 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:49.834026 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:49.834485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:49.834909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:49.869269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1d9be22f-01d5-429e-b052-a6e55dad82b9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/ips" status: 200 len: 145 microversion: 2.1 time: 0.050503 Sep 08 16:10:49.870210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 197/419] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:10:49 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:10:50.519311 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:50.520222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:50.531187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:50.532043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:50.532748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:50.533871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:50.534544 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:50.534958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:50.677197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:50.685601 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:50.687050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:50.688280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-01420373-eeb9-45c9-842c-6a5df21f7f6c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1720 microversion: 2.20 time: 0.176059 Sep 08 16:10:50.688843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 223/420] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:50 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:51.714494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:51.715094 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:51.717579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:51.723020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:51.723535 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:51.723949 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:51.724731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:51.725176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:51.725592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:51.870821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:51.881212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:51.882688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:51.883930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a1977dd2-3292-4d49-ba32-4080e180487b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1720 microversion: 2.20 time: 0.173392 Sep 08 16:10:51.884490 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 198/421] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:51 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:52.489369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-37edbccf-ba4c-412b-8d5a-e09a9ad43e95 req-07cf9577-0feb-4eae-b2b6-217ddc534e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "name": "network-vif-unplugged", "status": "completed", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:52.500327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-37edbccf-ba4c-412b-8d5a-e09a9ad43e95 req-07cf9577-0feb-4eae-b2b6-217ddc534e02 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:52.500801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-37edbccf-ba4c-412b-8d5a-e09a9ad43e95 req-07cf9577-0feb-4eae-b2b6-217ddc534e02 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:52.501223 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-37edbccf-ba4c-412b-8d5a-e09a9ad43e95 req-07cf9577-0feb-4eae-b2b6-217ddc534e02 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:52.512882 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-37edbccf-ba4c-412b-8d5a-e09a9ad43e95 req-07cf9577-0feb-4eae-b2b6-217ddc534e02 service nova] Creating event network-vif-unplugged:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:10:52.517798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-37edbccf-ba4c-412b-8d5a-e09a9ad43e95 req-07cf9577-0feb-4eae-b2b6-217ddc534e02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032212 Sep 08 16:10:52.518376 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 224/422] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:10:52.909723 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:52.910339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:52.917947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:52.918601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:52.919074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:52.920274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:52.921510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:52.922093 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.058482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:53.066737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:53.068562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:53.069725 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-85d871cb-605d-4c55-a594-dfaa518b8f79 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1723 microversion: 2.20 time: 0.164123 Sep 08 16:10:53.070306 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 199/423] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:52 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:53.095483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe5ff534-ef77-4312-ad18-b6fa338dc353"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:53.097914 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:53.104458 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.104951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.105413 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.106318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.106813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.107210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.310957 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "338d317e-fce8-4992-9844-092e831df2b9"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:53.313400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:53.320302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.320795 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.321322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.322294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.322772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.323269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.432467 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c607559e-7f2b-4a06-8b41-17c028c4e3a7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341292 Sep 08 16:10:53.433623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 225/424] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 8 16:10:53 2022] POST /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:10:53.596373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:10:53.597033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:53.604028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.604501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.604933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.605619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.606068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.606485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.647502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a4e6d57f-8357-4eef-827f-36e02870d77d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340478 Sep 08 16:10:53.648096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 200/425] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:10:53 2022] POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:10:53.651618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120783) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 16:10:53.733921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5132b456-4c66-423d-9a6b-d7a1e3295987 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/action" status: 202 len: 0 microversion: 2.20 time: 0.141841 Sep 08 16:10:53.734936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 226/426] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 16:10:53 2022] POST /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 16:10:53.744538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:53.745234 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:53.759286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.759815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.760238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.760923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:53.761372 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:53.761845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:53.919754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:53.930210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:53.931738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:53.932915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-afe800ae-deaf-4dce-81db-4ccdf0fcb259 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1749 microversion: 2.20 time: 0.193508 Sep 08 16:10:53.933476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 201/427] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:53 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1749 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:54.959417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:54.960080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:54.966312 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:54.966793 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:54.967216 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:54.967949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:54.968393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:54.968808 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:55.106673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:55.120468 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:55.121905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:55.123096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-24ebf5fd-579c-4c17-843f-bab35bd9580d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.168659 Sep 08 16:10:55.123674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 227/428] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:54 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:56.154946 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:56.155911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:56.166986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:56.167478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:56.167952 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:56.168654 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:56.169113 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:56.169540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:56.303153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:56.312496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:56.313958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:56.315128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a67ce8fe-66a2-435b-ac8e-cbcbd0caa793 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.166978 Sep 08 16:10:56.315783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 202/429] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:56 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:56.805828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:56.806395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:56.815374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:56.816032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:56.816597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:56.817943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:56.818554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:56.819313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:56.943801 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lazy-loading 'services' on Instance uuid 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:10:57.068337 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0cbca8d7-395c-450a-a8d2-02e4adc096b1 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f/os-volume_attachments/25f90c7a-621a-4337-ae2a-0dea4f62791f" status: 202 len: 0 microversion: 2.1 time: 0.267899 Sep 08 16:10:57.068912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 228/430] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:10:56 2022] DELETE /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f/os-volume_attachments/25f90c7a-621a-4337-ae2a-0dea4f62791f => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:10:57.346589 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:57.347769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:57.358787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:57.359651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:57.360378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:57.361521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:57.362284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:57.362998 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:57.370476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:10:57.505338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:57.514198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:57.515652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:57.516811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ef0e04d9-8376-48bd-a89f-ddd4587771ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.177042 Sep 08 16:10:57.517367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 203/431] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:57 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:58.543013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:58.543729 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:58.550639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:58.551117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:58.551572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:58.552256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:58.552698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:58.553115 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:58.686286 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:58.695563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:58.696989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:58.698219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c1764f55-f96e-4515-93e3-d6072a069e35 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.159709 Sep 08 16:10:58.698835 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 229/432] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:58 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:10:59.724268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:10:59.724996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:10:59.731944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:59.732429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:59.732859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:59.733551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:10:59.734004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:10:59.734425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:10:59.864683 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:59.873593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:59.875014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:10:59.876198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cdfde85f-dce9-4fce-81ae-2b8be1d6d873 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.155961 Sep 08 16:10:59.876755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 204/433] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:10:59 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:00.003044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-573372434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1361964657", "security_groups": [{"name": "tempest-secgroup-smoke-350650337"}], "block_device_mapping_v2": [{"uuid": "8305755e-f391-4224-8f92-7cf080594562", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5102509-85cc-4d13-8399-20742dacc4a9"}]}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:00.117219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.network.neutron [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] validate_networks() for [('f5102509-85cc-4d13-8399-20742dacc4a9', None, None, None, None, None)] {{(pid=120783) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:11:00.494204 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Flavor limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:11:00.494646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Image limits 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:11:00.495141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Flavor pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:11:00.495566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Image pref 0:0:0 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:11:00.496001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.virt.hardware [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120783) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:11:00.505049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:00.505522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:00.505958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:00.506659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:00.507077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:00.507514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:00.524374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:11:00.528821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for user 77aeaed3d55945e49b0eb6e3c0519294 and project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:11:00.587406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Going to run 1 instances... {{(pid=120783) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:11:00.589636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8305755e-f391-4224-8f92-7cf080594562',volume_size=None,volume_type=None)] {{(pid=120783) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:11:00.726099 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-49534ce2-c60e-4d24-a4a3-3fc027b408ef tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726897 Sep 08 16:11:00.726718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 230/434] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:10:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:11:00.737887 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fcda832a-e73e-499d-88b2-cc435b121df6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:00.738497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fcda832a-e73e-499d-88b2-cc435b121df6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:00.794499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fcda832a-e73e-499d-88b2-cc435b121df6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:00.801711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fcda832a-e73e-499d-88b2-cc435b121df6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1094 microversion: 2.1 time: 0.067694 Sep 08 16:11:00.802277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 205/435] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:00 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:00.902788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:00.904080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:00.913044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:00.913744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:00.914674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:00.915582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:00.916362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:00.917490 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:01.111166 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:01.124331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:01.126262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:01.127613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c2e6a82a-e4d1-4bb4-b8c1-8821468c77ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.230093 Sep 08 16:11:01.128566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 231/436] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:00 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:01.244209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-374ff784-3c81-4ab5-a6a1-2ecc2e650d55 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:01.250819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-374ff784-3c81-4ab5-a6a1-2ecc2e650d55 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:01.251300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-374ff784-3c81-4ab5-a6a1-2ecc2e650d55 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:01.251769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-374ff784-3c81-4ab5-a6a1-2ecc2e650d55 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:01.317571 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-374ff784-3c81-4ab5-a6a1-2ecc2e650d55 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Going to try to stop instance {{(pid=120782) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 16:11:01.377928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-374ff784-3c81-4ab5-a6a1-2ecc2e650d55 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action" status: 202 len: 0 microversion: 2.1 time: 0.137674 Sep 08 16:11:01.383853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 206/437] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:11:01 2022] POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:11:01.387519 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:01.388391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:01.394750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:01.395477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:01.395949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:01.396869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:01.397341 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:01.397742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:01.529260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:01.537566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d29faa1e-411e-44b5-91c9-3e02bc7e292d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.154248 Sep 08 16:11:01.538132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 232/438] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:01 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:01.829670 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:01.830475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:01.840221 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:01.840965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:01.841605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:01.842619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:01.843299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:01.843985 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:01.917793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:01.926129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0d8cf24c-ba3a-478d-abde-84b6f0619cb8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1136 microversion: 2.1 time: 0.103774 Sep 08 16:11:01.926900 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 207/439] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:01 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1136 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:02.157110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:02.157691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:02.164222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:02.164697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:02.165122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:02.165837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:02.166283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:02.166701 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:02.316805 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:02.326308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:02.335419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:02.335419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-44870698-9c15-4612-bacb-7847881a59ab tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.175906 Sep 08 16:11:02.335419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 233/440] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:02 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:02.560535 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:02.561147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:02.567600 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:02.568080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:02.568508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:02.569199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:02.569650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:02.570069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:02.712064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:02.720717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4d47ed5b-4bd0-4f1d-9d51-26ff916ebc01 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.164122 Sep 08 16:11:02.721516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 208/441] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:02 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:02.950226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:02.950830 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:02.957958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:02.958643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:02.959244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:02.960297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:02.960937 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:02.961542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.036767 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:03.044823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6ad84cf0-1c6d-47c9-9c46-f2f1a3813182 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1192 microversion: 2.1 time: 0.098397 Sep 08 16:11:03.045379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 234/442] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:02 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:03.355341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:03.355994 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:03.362849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.363620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.364246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.364938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.365388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.365803 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.542644 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:03.543262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:03.549699 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.550306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.550826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.551635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.552342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.552970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.557419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:03.573954 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:03.583132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:03.592859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:03.594863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7762c278-9b02-42dd-928a-24d600d3a262 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1751 microversion: 2.20 time: 0.243914 Sep 08 16:11:03.595604 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 209/443] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:03 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1751 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:03.617693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:11:03.711942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7742506a-0b8e-4150-9dbb-158684907bfd tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 204 len: 0 microversion: 2.1 time: 0.172818 Sep 08 16:11:03.712958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 235/444] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:11:03 2022] DELETE /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:11:03.721770 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:03.722574 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:03.729817 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.730327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.730754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.731437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.731907 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.732322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.744940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:03.745959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:03.752156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.752990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.753629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.754639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:03.755306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:03.755966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:03.899060 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:03.907686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-29564cd9-cf34-4825-badf-d239b06c79b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.166912 Sep 08 16:11:03.908261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 236/445] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:03 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:03.924247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:03.933287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fd7e61d3-0270-4e50-b9f3-9df98f5ce786 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1513 microversion: 2.1 time: 0.215342 Sep 08 16:11:03.933867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 210/446] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:03 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:04.069386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:04.070394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:04.077916 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.078547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.079218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.080404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.080875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.081362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.144491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:04.152251 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-34904cee-6235-4627-84ab-364c43283403 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1210 microversion: 2.1 time: 0.088457 Sep 08 16:11:04.152846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 237/447] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:04 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:04.625778 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:04.626590 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:04.637392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.637878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.638312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.639006 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.639637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.640053 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.775261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:04.784081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:04.785515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:04.786848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b159ae8f-9401-4bf9-82b9-946b16de504b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.168012 Sep 08 16:11:04.787385 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 211/448] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:04 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:04.935839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:04.936937 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:04.948227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.949104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.949532 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.950236 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.950659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.951073 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.956949 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:04.957555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:04.963777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.964261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.964690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:04.965387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:04.965836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:04.966258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:05.079957 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:05.088215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a994c514-9c4a-4be3-9d62-b705803edf11 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.159074 Sep 08 16:11:05.088784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 238/449] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:04 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:05.093643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:05.101615 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-01caed82-bc42-4563-9154-eb8cd7cbdcc7 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1513 microversion: 2.1 time: 0.148585 Sep 08 16:11:05.102254 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 212/450] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:04 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:05.178312 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:05.179602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:05.187530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:05.187943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:05.188650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:05.189049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:05.189494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:05.189911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:05.337779 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:05.345938 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-68bcf638-fefb-40a3-b450-cf8eb68f82e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1277 microversion: 2.1 time: 0.174286 Sep 08 16:11:05.346506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 239/451] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:05 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:05.813022 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:05.813655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:05.820763 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:05.821246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:05.821673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:05.822356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:05.822810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:05.823225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.057915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:06.067677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:06.069043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:06.070206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-37df6fcd-629c-4e00-9da6-84f0c00a2a9b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.261292 Sep 08 16:11:06.070770 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 213/452] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:05 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:11:06.114227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:06.114837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:06.122476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.122960 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.123557 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.124250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.124724 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.124877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:06.125145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.125720 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:06.131908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.132451 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.132938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.133676 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.134206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.134729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.268404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:06.277469 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d9671e40-43af-4b29-ac3e-bc7dd8d3cfa4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.167194 Sep 08 16:11:06.278086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 240/453] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:06 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:06.340671 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:06.349030 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-908373fb-edc5-48bb-b520-dda70106fcc8 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1513 microversion: 2.1 time: 0.228533 Sep 08 16:11:06.353620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 214/454] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:06 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:06.369734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:06.370884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:06.378061 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.378552 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.379227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.380112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.380709 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.381282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.564984 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0ee04321-f248-48af-873f-447dcabacc8f req-496fe9e0-fa37-492c-9c9f-a450311976b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dfe24f-aaf4-47c1-8f58-017da860325c", "tag": "014b0d74-7376-4159-8207-1355dff59ef4"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:06.594456 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0ee04321-f248-48af-873f-447dcabacc8f req-496fe9e0-fa37-492c-9c9f-a450311976b2 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:06.596810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0ee04321-f248-48af-873f-447dcabacc8f req-496fe9e0-fa37-492c-9c9f-a450311976b2 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:06.597420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0ee04321-f248-48af-873f-447dcabacc8f req-496fe9e0-fa37-492c-9c9f-a450311976b2 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:06.628498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0ee04321-f248-48af-873f-447dcabacc8f req-496fe9e0-fa37-492c-9c9f-a450311976b2 service nova] Creating event network-changed:014b0d74-7376-4159-8207-1355dff59ef4 for instance 08dfe24f-aaf4-47c1-8f58-017da860325c on hv-cinder-85625 Sep 08 16:11:06.638969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0ee04321-f248-48af-873f-447dcabacc8f req-496fe9e0-fa37-492c-9c9f-a450311976b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085732 Sep 08 16:11:06.641048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 215/455] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:11:06.664764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:06.677858 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-87ac964e-0782-4776-a046-f37ccd3537fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.310993 Sep 08 16:11:06.678829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 241/456] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:06 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:07.034654 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-c31b204d-9910-4ea3-90e5-1e83bf47cf9d req-65aba78e-5a2e-4324-9459-01aa7492b753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f", "name": "network-vif-deleted", "tag": "d3f14c71-ffb0-48ef-8111-952d43ed0de6"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:07.045017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c31b204d-9910-4ea3-90e5-1e83bf47cf9d req-65aba78e-5a2e-4324-9459-01aa7492b753 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.045499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c31b204d-9910-4ea3-90e5-1e83bf47cf9d req-65aba78e-5a2e-4324-9459-01aa7492b753 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.045927 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c31b204d-9910-4ea3-90e5-1e83bf47cf9d req-65aba78e-5a2e-4324-9459-01aa7492b753 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.056993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-c31b204d-9910-4ea3-90e5-1e83bf47cf9d req-65aba78e-5a2e-4324-9459-01aa7492b753 service nova] Creating event network-vif-deleted:d3f14c71-ffb0-48ef-8111-952d43ed0de6 for instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f on hv-cinder-85625 Sep 08 16:11:07.061977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-c31b204d-9910-4ea3-90e5-1e83bf47cf9d req-65aba78e-5a2e-4324-9459-01aa7492b753 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Sep 08 16:11:07.062726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 216/457] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:07.096268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:07.097110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:07.103329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.103910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.104399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.105339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.105919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.106396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.249525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:07.259134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:07.260934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:07.262069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-400a4ab4-12f4-46ed-8523-17d9fa0d0d0a tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.170244 Sep 08 16:11:07.262616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 242/458] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:07 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:07.300675 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:07.301367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:07.307987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.308591 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.309056 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.309797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.310256 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.311381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.373691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:07.374369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:07.380312 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.380991 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.381417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.382102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.382568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.382983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.420902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.421518 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.422078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.422646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lazy-loading 'fault' on Instance uuid 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:11:07.466430 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2127487c50884141b2776f05e96471fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bafdc72abf95401f8784411bc8e55822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:07.474966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-30bfb457-7460-4de2-9b82-d27fe1869f83 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 200 len: 1308 microversion: 2.1 time: 0.106088 Sep 08 16:11:07.475577 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 243/459] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:07 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:07.703545 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:07.704209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:07.710631 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.711114 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.711580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.712301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:07.712743 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:07.713172 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:07.814802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:07.825250 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-15aba79d-cd7d-486d-bce4-51f4aca1c0f4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.528762 Sep 08 16:11:07.825855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 217/460] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:07 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:07.862671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:07.876174 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-03007afe-abf5-424d-80aa-36c8e34ec97c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.176588 Sep 08 16:11:07.877257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 244/461] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:07 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:08.288874 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:08.289478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:08.297249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.297731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.298257 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.298948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.299599 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.300017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.498682 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:08.499387 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] [instance: 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:08.500011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:08.506020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.506696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.507280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.508273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.509032 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:08.509185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.509501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.510920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:08.512373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e19adfde-0a0d-425b-8268-a0a0846185b4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.228573 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] HTTP exception thrown: Instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f could not be found. Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Request method failure captured: Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f HTTP/1.1 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhONjZ7UwcM7XmrZEde7znZUd7lIpTqNKKLj2HOLdPOCmsvSgquzeGRj5M05IQg4Q-ukszozhRuRH_dPQC-Xk1V4SnCyTqMgjaAaGulmC3fw9eShSIHhSbwKG6fceA5SoXd0P8Qc9X3SO7CAb4mScXbo1jVUg3mtcyhS-9s7Nkz22o0 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: bafdc72abf95401f8784411bc8e55822 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesSnapshotTestJSON-502902543 Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:11:08.528153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bafdc72abf95401f8784411bc8e55822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bafdc72abf95401f8784411bc8e55822", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bafdc72abf95401f8784411bc8e55822"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bafdc72abf95401f8784411bc8e55822"}]}] Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesSnapshotTestJSON-502902543 Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: bafdc72abf95401f8784411bc8e55822 Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-502902543 Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesSnapshotTestJSON-502902543-project Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 2127487c50884141b2776f05e96471fd Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesSnapshotTestJSON-502902543-project Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f could not be found. Sep 08 16:11:08.529562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f'} Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f could not be found. Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:11:08.530423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f could not be found. Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f could not be found. Sep 08 16:11:08.532088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:08.533353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] Returning 404 to user: Instance 36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:11:08.533353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-70d8fa28-f4a6-47bc-9204-4523c7f7e6d6 tempest-VolumesSnapshotTestJSON-502902543 tempest-VolumesSnapshotTestJSON-502902543-project] 10.222.0.27 "GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f" status: 404 len: 111 microversion: 2.1 time: 0.033181 Sep 08 16:11:08.533353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 245/462] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:08 2022] GET /compute/v2.1/servers/36cf2fa7-4821-4e26-b9fe-ef0d051a5d2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:11:08.537088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 218/463] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:08 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:08.853263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:08.853893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:08.866867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.867370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.876230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.877022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.877503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.877974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.901382 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:08.902040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:08.926163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.927343 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.927989 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:08.928893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:08.930260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:08.931188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:09.137257 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:09.138336 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:09.148846 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fb3d3131-59bd-40ea-a54a-2893ac7e2924 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.251336 Sep 08 16:11:09.150231 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 219/464] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:08 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:09.156100 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-44d7bf83-d8a1-4586-b687-bf203b5a0c16 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.304230 Sep 08 16:11:09.157133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 246/465] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:08 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:09.544867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:09.545868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:09.553174 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:09.553907 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:09.554543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:09.555258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:09.555883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:09.556670 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:09.706158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:09.717027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:09.719364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:09.720544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e54b30c2-4e22-43e0-969b-dc76511797c4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.179765 Sep 08 16:11:09.721335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 220/466] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:09 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:10.182226 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:10.185352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:10.186393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:10.187066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:10.203002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:10.204762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:10.205266 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:10.205702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:10.206412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:10.206865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:10.207294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:10.211561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:10.212211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:10.212707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:10.213398 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:10.213869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:10.214293 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:10.252341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:10.387352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:10.396683 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-19ae68c2-fc0e-455a-b049-775b30978c89 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.218407 Sep 08 16:11:10.397990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 221/467] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:10 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:10.409163 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:10.418720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1edc5297-33b1-45eb-bb93-537bc0f9f900 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.248188 Sep 08 16:11:10.432221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 247/468] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:10 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:10.752465 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:10.753087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:10.760943 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:10.761622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:10.762305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:10.763198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:10.763780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:10.764281 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:10.800868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:10.911570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:10.920808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:10.922286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:10.923503 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5a2832a4-2b06-4aba-a661-410ec999bf18 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.175225 Sep 08 16:11:10.924071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 222/469] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:10 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:11:11.424770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:11.425684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:11.429275 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:11.430506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:11.444055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:11.444861 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:11.445570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:11.446715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:11.448096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:11.448806 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:11.453631 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:11.454614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:11.462306 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:11.463337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:11.463982 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:11.464969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:11.465506 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:11.466318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:11.608352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:11.618578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e91c6ae4-ce20-48f7-9161-266d1126e367 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.200703 Sep 08 16:11:11.620157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 248/470] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:11 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:11.620361 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:11.629563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-96cd36cc-56b7-48bc-99ea-d1c0e97b9037 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.189556 Sep 08 16:11:11.635773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 223/471] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:11 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:11.957462 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:11.958095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:11.974667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:11.975171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:11.975660 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:11.976380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:11.976828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:11.977253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:12.119512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:12.128597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:12.130030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:12.131221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-12c1f3be-cfda-4332-acb8-c9c0198a6e28 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.178719 Sep 08 16:11:12.132169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 249/472] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:11 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:12.643864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:12.644484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:12.651187 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:12.651712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:12.652131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:12.652816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:12.653316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:12.653733 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:12.662161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:12.662729 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:12.674500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:12.675106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:12.675903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:12.676841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:12.677528 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:12.678250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:12.698820 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:12.823312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:12.833300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:12.838723 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ba963630-3905-45cb-84c0-50419b0767ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.198917 Sep 08 16:11:12.841611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-21ec584f-7082-492c-9f81-81a0bc7b14e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.183045 Sep 08 16:11:12.842866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 250/473] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:12 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:12.854831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 224/474] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:12 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:13.156688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:13.157296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:13.163757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:13.164579 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:13.165231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:13.170719 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:13.171525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:13.172204 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:13.313280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:13.325084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:13.327675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:13.329044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-416c4ed0-6e2a-4432-b045-42620ce7788b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.176328 Sep 08 16:11:13.330030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 251/475] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:13 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:13.861877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:13.862455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:13.864721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:13.865370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:13.869715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:13.870340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:13.870756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:13.871478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:13.871945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:13.872086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:13.872364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:13.872531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:13.872849 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:13.873541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:13.873993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:13.874417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:14.019431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:14.019895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:14.029047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c3f52374-776c-48c7-9414-2673915a43a6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.168060 Sep 08 16:11:14.031512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 252/476] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:13 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:14.031643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4108e53d-002d-44a1-b444-045ae3c21f39 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.172825 Sep 08 16:11:14.031643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 225/477] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:13 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:14.356112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:14.356748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:14.365063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:14.365557 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:14.365983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:14.366683 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:14.367133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:14.367575 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:14.507890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:14.517147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:14.518581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:14.519806 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dc04a5d5-a9fe-4dad-b550-3337a9497a45 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.167693 Sep 08 16:11:14.520370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 253/478] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:14 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:15.052532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:15.054028 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:15.054942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:15.056219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:15.061516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:15.062015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:15.062442 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:15.063120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:15.063624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:15.064043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:15.064451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:15.065011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:15.065501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:15.066373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:15.067192 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:15.067639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:15.220384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:15.229948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c00da9c7-7c18-4850-a7c8-954a2c049538 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.181153 Sep 08 16:11:15.230786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 226/479] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:15 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:15.236378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:15.249034 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d558c5c2-05be-4b68-9307-26c9e12c60cb tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.198942 Sep 08 16:11:15.250054 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 254/480] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:15 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:15.546877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:15.547536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:15.554263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:15.554750 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:15.555286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:15.556042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:15.556508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:15.557088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:15.703677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:15.712202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:15.713624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:15.714773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-69ff5f53-babc-4e7f-91f4-d834c1a52fe3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.172258 Sep 08 16:11:15.715332 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 227/481] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:15 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:16.253702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:16.254330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:16.260963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:16.262755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:16.263365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:16.264331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:16.264886 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:16.265410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:16.276808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:16.277550 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:16.287489 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:16.288729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:16.289616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:16.290733 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:16.291500 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:16.292148 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:16.440435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:16.449910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:16.450978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8f4cbfb6-d940-4a8c-ac13-f62dfff0b9ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.201143 Sep 08 16:11:16.451819 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 255/482] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:16 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:16.473842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7a821ae9-81c4-4205-93ce-4ac704a22613 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.201107 Sep 08 16:11:16.474437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 228/483] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:16 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:16.741575 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:16.742087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:16.748572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:16.749057 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:16.749483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:16.750177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:16.750632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:16.751040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:16.891025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:16.899971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:16.901400 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:16.902562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8738236a-5d0b-45a9-babd-de27d5cd169d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.165112 Sep 08 16:11:16.903309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 256/484] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:16 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:17.474104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:17.474728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:17.481101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:17.481583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:17.482024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:17.482765 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:17.483224 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:17.483669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:17.498309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:17.498875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:17.505388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:17.505869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:17.506268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:17.506958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:17.507407 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:17.507851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:17.625200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:17.633042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-75e091f4-6942-4498-8e05-6222b9cff2af tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.162858 Sep 08 16:11:17.633688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 229/485] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:17 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:17.642512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:17.651740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ef4be29b-024f-4943-a4de-f083fc99a06b tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.157335 Sep 08 16:11:17.652370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 257/486] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:17 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:17.928785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:17.929481 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:17.936270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:17.936870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:17.944071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:17.944835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:17.945304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:17.945710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:18.079342 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:18.088594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:18.090106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:18.091283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b635ae79-363e-418b-b8f5-bb813339ae20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.166718 Sep 08 16:11:18.091878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 230/487] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:17 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:18.657584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:18.658350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:18.666501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:18.667593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:18.668227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:18.669291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:18.671167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:18.671795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:18.676810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:18.677681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:18.684483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:18.684965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:18.685451 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:18.686147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:18.686612 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:18.687044 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:18.838987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:18.841620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:18.847706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-73696550-83fb-4a09-8e9d-5358cd36e0df tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.175434 Sep 08 16:11:18.848283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 231/488] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:18 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:11:18.849849 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ee57e135-36e3-4a59-95e9-9df7e3d3e171 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.196369 Sep 08 16:11:18.856829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 258/489] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:18 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:19.121286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:19.122267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:19.132620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:19.133419 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:19.134139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:19.135269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:19.136072 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:19.136782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:19.271594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:19.281585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:19.283014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:19.284199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-205ea7d9-cb1d-4704-8589-95406407ca34 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.169635 Sep 08 16:11:19.284817 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 232/490] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:19 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:19.875323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:19.876283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:19.876502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:19.877229 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:19.887104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:19.887922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:19.888178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:19.888713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:19.888861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:19.889153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:19.889415 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:19.889853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:19.890010 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:19.890274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:19.890426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:19.890724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:20.022222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:20.022408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:20.030260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4f00b013-0d01-4810-a309-39de94966e2c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.160508 Sep 08 16:11:20.031037 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 233/491] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:19 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:20.031178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4709d1cb-d0c1-4833-a83b-76263239250d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.162293 Sep 08 16:11:20.031574 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 259/492] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:19 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:20.313229 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:20.313964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:20.321686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:20.322250 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:20.322754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:20.323618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:20.324114 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:20.324606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:20.466936 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:20.480230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:20.482631 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:20.483827 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f5c06f65-7f7e-4efb-9c7d-42b36bdb8f72 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.176311 Sep 08 16:11:20.484392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 234/493] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:20 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:21.057529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:21.058995 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:21.060098 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:21.060259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:21.069265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:21.070071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:21.070348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:21.070794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:21.071052 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:21.071814 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:21.072130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:21.072729 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:21.072968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:21.073442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:21.073682 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:21.074370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:21.208260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:21.209414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:21.216044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d6c6d991-e304-426a-84bf-aa91ad853879 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.165013 Sep 08 16:11:21.216582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 260/494] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:21 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:21.218052 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ec4ffebb-c0c0-4bdf-bc0b-2ee28c3880ee tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.166454 Sep 08 16:11:21.218620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 235/495] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:21 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:21.513786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:21.514654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:21.524881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:21.525673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:21.526394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:21.527536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:21.528321 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:21.529018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:21.670964 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:21.682506 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:21.683976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:21.685157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f8f15c0a-1da0-4e3b-98c6-1d0348a13e4b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.178284 Sep 08 16:11:21.685711 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 261/496] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:21 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:22.238931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:22.239649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:22.240872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:22.241474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:22.242072 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=78 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:22.247376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:22.247892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:22.248170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:22.248298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:22.248637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:22.249172 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:22.249291 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:22.249656 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:22.249869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:22.250083 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:22.250296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:22.250708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:22.389318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:22.397819 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b579934e-6fc7-49c1-8418-92d9c08ff732 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1724 microversion: 2.1 time: 0.160722 Sep 08 16:11:22.398599 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 262/497] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:22 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:22.402416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:22.412255 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-201221cb-3245-43ce-8ef8-bc237bcd668e tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.177571 Sep 08 16:11:22.412824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 236/498] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:22 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:22.710190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:22.710852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:22.717077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:22.717569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:22.717999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:22.718683 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:22.719134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:22.719576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:22.853210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:22.862906 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:22.864381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:22.865530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-70829476-7afe-4188-8f26-b3d6f7bc4db7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.159297 Sep 08 16:11:22.866153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 263/499] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:22 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:23.424226 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:23.424913 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:23.432833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.433405 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.433978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.434781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.435315 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.435809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.437219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:23.438022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:23.446265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.446839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.447355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.448306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.448844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.449345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.574053 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:23.578169 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:23.580376 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:23.583685 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a01ed737-9441-4554-a59f-4f3be79e6e3a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1701 microversion: 2.1 time: 0.165196 Sep 08 16:11:23.584743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 237/500] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:23 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1701 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:23.594126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-31a8f5a5-02db-4777-9ebb-89e3eb19a2b3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.161611 Sep 08 16:11:23.595086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 264/501] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:23 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:23.615859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-396424c2-1241-4782-bb50-cf0cca16a890 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:23.622801 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-396424c2-1241-4782-bb50-cf0cca16a890 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.623293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-396424c2-1241-4782-bb50-cf0cca16a890 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.623763 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-396424c2-1241-4782-bb50-cf0cca16a890 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.648384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-396424c2-1241-4782-bb50-cf0cca16a890 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Going to try to start instance {{(pid=120782) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 16:11:23.741035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-396424c2-1241-4782-bb50-cf0cca16a890 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action" status: 202 len: 0 microversion: 2.1 time: 0.131689 Sep 08 16:11:23.741549 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 238/502] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:11:23 2022] POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:11:23.752180 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:23.752785 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:23.758849 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.759329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.759799 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.760483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.760932 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.761352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.892532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:23.893355 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:23.899736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.900206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.900856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.901555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:23.901991 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:23.902610 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:23.914409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:23.924453 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3dcb186e-813d-4d7b-b224-70abd32c733a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1710 microversion: 2.1 time: 0.176084 Sep 08 16:11:23.925334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 265/503] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:23 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:24.122178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:24.131414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:24.132925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:24.134058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0310c6c7-98a4-4fca-bbc7-c52a938e8118 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.245981 Sep 08 16:11:24.147824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 239/504] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:23 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:24.622277 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:24.622911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:24.629800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:24.630323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:24.630754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:24.631420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:24.632082 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:24.632522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:24.768408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:24.776262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-04fb3a1f-6b23-4d11-af16-4bd351cc8faa tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.158003 Sep 08 16:11:24.776892 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 266/505] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:24 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:24.954793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:24.955346 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:24.962260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:24.962753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:24.963198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:24.963931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:24.964388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:24.964819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:25.104274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:25.113247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5dbd0888-b598-4122-8b0d-dba1240e575e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1710 microversion: 2.1 time: 0.163747 Sep 08 16:11:25.113829 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 240/506] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:24 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:25.160834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:25.161448 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:25.167771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:25.168263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:25.168695 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:25.169397 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:25.169878 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:25.170305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:25.174750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:25.310670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:25.319894 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:25.321280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:25.322451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3d536685-afb9-4d19-ba12-6e8bbf6a39ce tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.165677 Sep 08 16:11:25.322999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 267/507] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:25 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:25.801463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:25.802194 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:25.809821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:25.810429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:25.810967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:25.811849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:25.812416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:25.812942 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:25.955683 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:25.964164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fbe46303-b703-4eba-a90b-0bfdc6546949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.168273 Sep 08 16:11:25.964734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 241/508] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:25 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:26.141197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:26.142109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:26.152884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.153710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.154416 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:26.155536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.156327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.156932 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:26.294599 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:26.303116 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-74e8058f-153f-48c7-a37b-cb3268c6ead2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1714 microversion: 2.1 time: 0.168633 Sep 08 16:11:26.303713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 268/509] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:26 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1714 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:26.350710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:26.351660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:26.360811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.361299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.361733 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:26.362426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.362880 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.363301 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:26.504232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:26.513339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:26.514797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:26.516031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-af80db79-2c27-47ba-9423-721678ce4d69 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.171593 Sep 08 16:11:26.516574 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 242/510] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:26 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:26.682835 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-72f1081d-9737-4940-af73-fcd75ab58668 req-3fb97e0d-75e6-4377-a794-67761f7c11b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dfe24f-aaf4-47c1-8f58-017da860325c", "name": "network-vif-plugged", "status": "completed", "tag": "014b0d74-7376-4159-8207-1355dff59ef4"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:26.693617 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-72f1081d-9737-4940-af73-fcd75ab58668 req-3fb97e0d-75e6-4377-a794-67761f7c11b4 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.694094 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-72f1081d-9737-4940-af73-fcd75ab58668 req-3fb97e0d-75e6-4377-a794-67761f7c11b4 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.695706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-72f1081d-9737-4940-af73-fcd75ab58668 req-3fb97e0d-75e6-4377-a794-67761f7c11b4 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:26.708872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-72f1081d-9737-4940-af73-fcd75ab58668 req-3fb97e0d-75e6-4377-a794-67761f7c11b4 service nova] Creating event network-vif-plugged:014b0d74-7376-4159-8207-1355dff59ef4 for instance 08dfe24f-aaf4-47c1-8f58-017da860325c on hv-cinder-85625 Sep 08 16:11:26.714276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-72f1081d-9737-4940-af73-fcd75ab58668 req-3fb97e0d-75e6-4377-a794-67761f7c11b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035193 Sep 08 16:11:26.714920 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 269/511] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:26.987125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:26.987728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:26.996201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.996709 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.997126 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:26.997862 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:26.998443 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:26.998867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:27.148833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:27.160941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5872db62-c756-4c75-9e12-e88071083469 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.177711 Sep 08 16:11:27.161705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 243/512] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:26 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:27.548000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:27.549168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:27.559747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:27.560533 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:27.561235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:27.562350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:27.563092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:27.563865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:27.703757 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:27.712592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:27.714040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:27.715202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bdac3787-da89-4f6d-b177-de9e217b9e50 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.175229 Sep 08 16:11:27.715839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 270/513] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:27 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:28.189048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:28.189615 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:28.197205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:28.197684 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:28.198273 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:28.198949 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:28.199397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:28.199853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:28.338002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:28.348267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a9587aa0-b0fd-4887-a7cb-4d6a63e702a7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1265 microversion: 2.1 time: 0.166262 Sep 08 16:11:28.348841 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 244/514] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:28 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:28.741109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:28.741774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:28.748925 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:28.749432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:28.750384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:28.751277 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:28.751738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:28.752342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:28.890336 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:28.899594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:28.901266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:28.902817 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9273e798-2c9b-4b5b-92c4-b5e46ca7eac1 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.165733 Sep 08 16:11:28.903400 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 271/515] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:28 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:29.370807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:29.371807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:29.383078 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:29.383694 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:29.384126 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:29.384827 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:29.385343 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:29.386037 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:29.527212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:29.537091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-052ab546-1e6f-43a5-9152-2aa6f5937e8d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1451 microversion: 2.1 time: 0.170546 Sep 08 16:11:29.537664 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 245/516] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:29 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:29.559934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:29.560544 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:29.567023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:29.567503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:29.567931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:29.568643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:29.569095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:29.569514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:29.701711 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:29.709657 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0d1d3c99-a2bb-4160-9762-753307a202ed tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1451 microversion: 2.1 time: 0.153582 Sep 08 16:11:29.710233 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 272/517] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:29 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:29.929262 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:29.929867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:29.936204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:29.936692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:29.937115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:29.937871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:29.938358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:29.938735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:30.083355 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:30.093408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:30.094869 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:30.096216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-056874eb-26d0-422d-9b85-a7cc238c41e8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.170990 Sep 08 16:11:30.096999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 246/518] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:29 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:31.122011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:31.122549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:31.131652 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:31.132147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:31.132576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:31.133276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:31.133726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:31.134146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:31.364965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:31.374224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:31.375621 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:31.376798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-88e823f0-56b1-46f5-81de-cb0280e0ad76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.258881 Sep 08 16:11:31.377493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 273/519] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:31 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:31.643565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-b2f2d35e-242c-4b3c-8bbd-ff21b5e0d216 req-5843f5b3-0c88-470d-811d-c8b206c2667c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dfe24f-aaf4-47c1-8f58-017da860325c", "tag": "014b0d74-7376-4159-8207-1355dff59ef4"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:31.653776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b2f2d35e-242c-4b3c-8bbd-ff21b5e0d216 req-5843f5b3-0c88-470d-811d-c8b206c2667c service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:31.654238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b2f2d35e-242c-4b3c-8bbd-ff21b5e0d216 req-5843f5b3-0c88-470d-811d-c8b206c2667c service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:31.654677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-b2f2d35e-242c-4b3c-8bbd-ff21b5e0d216 req-5843f5b3-0c88-470d-811d-c8b206c2667c service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:31.666713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-b2f2d35e-242c-4b3c-8bbd-ff21b5e0d216 req-5843f5b3-0c88-470d-811d-c8b206c2667c service nova] Creating event network-changed:014b0d74-7376-4159-8207-1355dff59ef4 for instance 08dfe24f-aaf4-47c1-8f58-017da860325c on hv-cinder-85625 Sep 08 16:11:31.672070 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-b2f2d35e-242c-4b3c-8bbd-ff21b5e0d216 req-5843f5b3-0c88-470d-811d-c8b206c2667c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032190 Sep 08 16:11:31.672803 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 247/520] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:32.403194 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:32.403836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:32.410227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:32.410710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:32.411141 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:32.412068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:32.412522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:32.412945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:32.588618 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:32.598776 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:32.604549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:32.605765 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d319c7ea-3996-4a9e-8adf-ec0b8afbf3ec tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.206871 Sep 08 16:11:32.611665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 274/521] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:32 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:33.631364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:33.632199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:33.638845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:33.639325 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:33.639786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:33.640472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:33.640917 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:33.641334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:33.780281 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:33.790011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:33.791971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:33.793159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7baf71d1-8252-42a1-a4a0-6a5892dcfe20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.166191 Sep 08 16:11:33.793928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 248/522] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:33 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:34.745857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-5bbd6bc4-13e6-47c7-a554-e9ff924c79b6 req-76d72e9b-fe04-4f80-93e4-3510c1831326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "name": "network-vif-plugged", "status": "completed", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:34.757307 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5bbd6bc4-13e6-47c7-a554-e9ff924c79b6 req-76d72e9b-fe04-4f80-93e4-3510c1831326 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:34.758052 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5bbd6bc4-13e6-47c7-a554-e9ff924c79b6 req-76d72e9b-fe04-4f80-93e4-3510c1831326 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:34.758491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-5bbd6bc4-13e6-47c7-a554-e9ff924c79b6 req-76d72e9b-fe04-4f80-93e4-3510c1831326 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:34.771299 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-5bbd6bc4-13e6-47c7-a554-e9ff924c79b6 req-76d72e9b-fe04-4f80-93e4-3510c1831326 service nova] Creating event network-vif-plugged:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:11:34.778258 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-5bbd6bc4-13e6-47c7-a554-e9ff924c79b6 req-76d72e9b-fe04-4f80-93e4-3510c1831326 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036449 Sep 08 16:11:34.778726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 275/523] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:34.824547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:34.828529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:34.839473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:34.840061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:34.840592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:34.841398 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:34.842047 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:34.842464 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:35.107980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:35.117765 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:35.119506 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:35.120797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b7de5d53-3ccc-459f-984d-aced1f61cc40 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.305689 Sep 08 16:11:35.121521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 249/524] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:34 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:36.148693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:36.149744 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:36.156822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:36.157296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:36.157726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:36.158542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:36.158987 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:36.159540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:36.317473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:36.326115 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:36.327588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:36.328758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-935004a5-5bee-4dc2-b856-ff02b23e80e6 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.186153 Sep 08 16:11:36.329323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 276/525] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:36 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:37.355114 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:37.357065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:37.365817 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:37.366576 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:37.367188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:37.368157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:37.368868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:37.369668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:37.675481 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:37.694674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:37.701105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:37.703538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4190bbee-64c3-426c-bd9a-e0bb4434caae tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1807 microversion: 2.20 time: 0.353019 Sep 08 16:11:37.704842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 250/526] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:37 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1807 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:11:38.082563 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:38.084897 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:38.092440 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.093473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.094143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.095080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.096201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.097370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.129722 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bf67398b-55d6-4404-8dc2-34a109146a2b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/ips" status: 200 len: 149 microversion: 2.1 time: 0.051817 Sep 08 16:11:38.130310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 277/527] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:11:38 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:38.142154 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0674b780-1d8b-4b8f-aa98-5e494cb86672"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:38.145034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:38.152502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.153256 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.153892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.154799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.155503 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.156126 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.292133 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Invalid volume: volume 0674b780-1d8b-4b8f-aa98-5e494cb86672 is already attached to instances: 85d36039-930c-4f96-93c3-c9fb893ae77c Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: POST /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/os-volume_attachments HTTP/1.1 Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 74 Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:11:38.295202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {"volumeAttachment": {"volumeId": "0674b780-1d8b-4b8f-aa98-5e494cb86672"}} Sep 08 16:11:38.296836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Invalid volume: volume 0674b780-1d8b-4b8f-aa98-5e494cb86672 is already attached to instances: 85d36039-930c-4f96-93c3-c9fb893ae77c Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'server_id': '23052556-fe21-4d01-936b-c88007a44203', 'body': {'volumeAttachment': {'volumeId': '0674b780-1d8b-4b8f-aa98-5e494cb86672'}}} Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0674b780-1d8b-4b8f-aa98-5e494cb86672 is already attached to instances: 85d36039-930c-4f96-93c3-c9fb893ae77c Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:38.297757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0674b780-1d8b-4b8f-aa98-5e494cb86672 is already attached to instances: 85d36039-930c-4f96-93c3-c9fb893ae77c Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:38.299004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0674b780-1d8b-4b8f-aa98-5e494cb86672 is already attached to instances: 85d36039-930c-4f96-93c3-c9fb893ae77c Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 400 to user: Invalid volume: volume 0674b780-1d8b-4b8f-aa98-5e494cb86672 is already attached to instances: 85d36039-930c-4f96-93c3-c9fb893ae77c {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:11:38.301681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f780ab16-b243-4f33-a9a6-af9dc0fdedde tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.158879 Sep 08 16:11:38.303026 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 251/528] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:11:38 2022] POST /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203/os-volume_attachments => generated 174 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:11:38.306652 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:38.307144 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:38.313327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.313811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.314283 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.314993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.315458 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.316574 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.343994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:11:38.469640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0fa8ae5c-5310-4a58-8851-8ade47212665 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 204 len: 0 microversion: 2.1 time: 0.166658 Sep 08 16:11:38.470675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 278/529] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:11:38 2022] DELETE /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:11:38.480446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:38.481721 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:38.490024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.494459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.495433 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.496198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.496654 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.497076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.730720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:38.731895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:38.740575 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.741389 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.742039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.742966 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:38.743696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:38.744353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:38.904058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:38.916058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:38.917857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:38.919593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fc660d58-0c35-4810-97bd-ef671104f4dc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1794 microversion: 2.20 time: 0.193524 Sep 08 16:11:38.920339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 279/530] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:11:38 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1794 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:11:38.945449 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:38.956998 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-880c37d1-8117-405b-b68e-293921b756f0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1680 microversion: 2.1 time: 0.480905 Sep 08 16:11:38.957816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 252/531] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:38 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1680 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:39.981540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:39.982723 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:39.989749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:39.990526 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:39.991133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:39.992017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:39.992612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:39.993167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:40.153946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:40.162464 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-79c1f0ea-3c0c-4e9e-84ca-92b410157d19 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1680 microversion: 2.1 time: 0.184798 Sep 08 16:11:40.163406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 280/532] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:39 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:41.190754 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:41.191898 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:41.199158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:41.199873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:41.200397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:41.201267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:41.201822 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:41.202344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:41.335029 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:41.338259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eebc1e1a-27eb-4b19-a318-9136cf085364"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:41.345848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:41.356484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-10f8f3b7-dc09-4f1a-b4f5-ae601c035b38 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1614 microversion: 2.1 time: 0.170767 Sep 08 16:11:41.358918 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 253/533] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:41 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1614 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:41.378693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:41.381169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:41.382000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:41.382713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:41.384231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:41.385071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:41.385786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:41.838305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f29cd95c-67ad-4dde-bafd-a7a3e6a44748 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510473 Sep 08 16:11:41.844845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 281/534] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:11:41 2022] POST /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:42.317221 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-06cf0857-d6fd-4563-8947-71d8eb0334df req-676b67a9-558f-4c3e-a6b9-7cbd07ceefd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23052556-fe21-4d01-936b-c88007a44203", "name": "network-vif-deleted", "tag": "73501033-f27c-4891-8146-0beb36569265"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:42.343558 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-06cf0857-d6fd-4563-8947-71d8eb0334df req-676b67a9-558f-4c3e-a6b9-7cbd07ceefd2 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:42.344035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-06cf0857-d6fd-4563-8947-71d8eb0334df req-676b67a9-558f-4c3e-a6b9-7cbd07ceefd2 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:42.344455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-06cf0857-d6fd-4563-8947-71d8eb0334df req-676b67a9-558f-4c3e-a6b9-7cbd07ceefd2 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:42.349564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:42.374604 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-06cf0857-d6fd-4563-8947-71d8eb0334df req-676b67a9-558f-4c3e-a6b9-7cbd07ceefd2 service nova] Creating event network-vif-deleted:73501033-f27c-4891-8146-0beb36569265 for instance 23052556-fe21-4d01-936b-c88007a44203 on hv-cinder-85625 Sep 08 16:11:42.388639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:42.396545 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:42.409651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:42.415182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-06cf0857-d6fd-4563-8947-71d8eb0334df req-676b67a9-558f-4c3e-a6b9-7cbd07ceefd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094165 Sep 08 16:11:42.416424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 254/535] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:42.416585 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:42.417121 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:42.417871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:42.418328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:42.418745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:42.480803 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:42.562165 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:42.584621 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fac75c9e-4465-4e2a-82bb-38786992e563 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 200 len: 1327 microversion: 2.1 time: 0.203970 Sep 08 16:11:42.587578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 282/536] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:42 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:43.627986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:43.629466 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:43.641737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:43.642928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:43.643717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:43.645527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:43.648199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:43.648908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:43.692911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 HTTP/1.1 Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:11:43.695692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:11:43.698048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '23052556-fe21-4d01-936b-c88007a44203'} Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:11:43.699040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:11:43.701222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:11:43.702653 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:11:43.704644 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dc9f4584-cc78-4d98-945d-f617cc5d9a16 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 404 len: 111 microversion: 2.1 time: 0.098842 Sep 08 16:11:43.709476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 255/537] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:43 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:11:43.718604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa976412-c3f2-4356-8773-818915d31351 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '.version_select at 0x7f886024a700>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:43.770760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa976412-c3f2-4356-8773-818915d31351 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218296597" status: 202 len: 0 microversion: 2.1 time: 0.054726 Sep 08 16:11:43.775298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 283/538] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 16:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1218296597 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:11:45.513230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:45.514391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:45.521991 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:45.522750 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:45.523564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:45.524782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:45.525399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:45.525979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:45.636424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lazy-loading 'services' on Instance uuid 85d36039-930c-4f96-93c3-c9fb893ae77c {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:11:45.735053 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3836dea4-b1aa-4791-b4d5-e921b0c5da4d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments/0674b780-1d8b-4b8f-aa98-5e494cb86672" status: 202 len: 0 microversion: 2.1 time: 0.226188 Sep 08 16:11:45.736428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 256/539] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:11:45 2022] DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments/0674b780-1d8b-4b8f-aa98-5e494cb86672 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:11:45.745264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:45.747477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:45.765394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:45.765889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:45.766760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:45.767730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:45.768477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:45.769058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:45.822265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-85950e09-21a3-4dc9-90dc-b78383bc8114 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081643 Sep 08 16:11:45.823573 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 284/540] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:11:45 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:46.051852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-98b77bdd-3623-4724-bf70-3a095d9db827 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Action: 'create', calling method: .version_select at 0x7f88600d75e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-261248473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw8KYSpF9hS6TzLNIt2A6ZIjg2VO0QknJJkwideI9xBEYKsSsU7aV87hfQlpTlICQfuNmPg71Fa92vF14SGYDmJCL1FK/Ib8+U3sZF4dQ4kW55WU8SVtT9+eX7nUH9FDQ=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:46.068298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-98b77bdd-3623-4724-bf70-3a095d9db827 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Getting quotas for project 2245b7557087417bb8a32322c8673cef. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:11:46.072368 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-98b77bdd-3623-4724-bf70-3a095d9db827 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Getting quotas for user f3be588325bf40beae354c1237d8e9ea and project 2245b7557087417bb8a32322c8673cef. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:11:46.096959 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-98b77bdd-3623-4724-bf70-3a095d9db827 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.211557 Sep 08 16:11:46.097475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 257/541] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:11:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:46.836377 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:46.838751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:46.845773 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:46.846262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:46.846688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:46.847349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:46.848056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:46.848470 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:46.886383 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-10eda433-5d4e-4382-be3c-af36a996bf8c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054500 Sep 08 16:11:46.886954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 285/542] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:11:46 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:47.899805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:47.902252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:47.909515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:47.910005 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:47.910442 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:47.911139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:47.911630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:47.912056 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:47.942330 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2fddea6f-483a-42a2-a5dc-6b99cc2ac615 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047160 Sep 08 16:11:47.943087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 258/543] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:11:47 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:48.955917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:48.958000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:48.965130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:48.965616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:48.966050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:48.966741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:48.967200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:48.967655 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:48.997726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f7d40553-0bbf-484c-8f82-2ad3381150ef tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Sep 08 16:11:48.998305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 286/544] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:11:48 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:49.640050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:49.642271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:49.649438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:49.650076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:49.650556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:49.651277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:49.651781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:49.652204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:49.685174 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'flavor' on Instance uuid b43a6d26-3e4a-4fde-8461-ad70b4e96a46 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:11:49.844300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-90e24878-a969-483d-afc8-e4b1bd9dd5db tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/action" status: 200 len: 32 microversion: 2.1 time: 0.208322 Sep 08 16:11:49.844914 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 259/545] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:11:49 2022] POST /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:11:49.854639 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:49.855243 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:49.861330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:49.862012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:49.862474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:49.863345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:49.863823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:49.864244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.013937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:50.016510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:50.021440 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:50.023642 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:50.024253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:50.024835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.025617 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:50.026331 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:50.026857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.031810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-486586c3-9fc0-45ec-96ee-0e22212dbffb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.180935 Sep 08 16:11:50.032748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 287/546] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:49 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:50.061733 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-559c05af-fe7e-4599-b176-51838196176b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054114 Sep 08 16:11:50.073387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 260/547] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:11:50 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 16:11:50.130755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:50.131235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:50.137498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:50.137957 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:50.138380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.139062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:50.139537 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:50.139950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.165515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:11:50.245496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1b6851fe-621d-4576-b07a-b35212bf1a46 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 204 len: 0 microversion: 2.1 time: 0.118407 Sep 08 16:11:50.246526 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 288/548] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:11:50 2022] DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:11:50.255079 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:50.256173 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:50.262695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:50.263186 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:50.263923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.264604 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:50.265048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:50.265463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:50.398593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:50.409622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f9d72755-5bf5-4252-b9cb-1dd9dcdb0220 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1680 microversion: 2.1 time: 0.158399 Sep 08 16:11:50.410351 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 261/549] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:50 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:51.056687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:51.057390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:51.064274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:51.064783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:51.065222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:51.066292 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:51.066746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:51.067176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:51.210124 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:51.218841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-59dd8b8a-9cf9-4f42-98b7-9a7d1d6f0556 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.166698 Sep 08 16:11:51.219575 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 289/550] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:51 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:51.441008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:51.441983 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:51.449925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:51.450532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:51.450994 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:51.451762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:51.452253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:51.452686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:51.590693 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:51.598842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1f9592cb-1b0e-425d-bc23-6e2fe3579dd7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1680 microversion: 2.1 time: 0.164545 Sep 08 16:11:51.599419 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 262/551] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:51 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:52.242737 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:52.243345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:52.250310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:52.250798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:52.251232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:52.251976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:52.252432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:52.252864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:52.389402 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:52.398455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4fa5936f-d092-44af-93d7-6cbb97095b42 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.159904 Sep 08 16:11:52.399028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 290/552] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:52 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:52.622984 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:52.624304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:52.626939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:52.633179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:52.633693 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:52.634169 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:52.634935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:52.635678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:52.636141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:52.860333 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:52.869139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e3fef145-8a1c-4a20-bba7-23d78c41a2df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1680 microversion: 2.1 time: 0.250349 Sep 08 16:11:52.883216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 263/553] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:52 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:53.407886 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-18fe6621-732d-4432-bee8-761e8878219b req-fb657581-96d8-440e-b5d5-a2d13b9f4fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d36039-930c-4f96-93c3-c9fb893ae77c", "name": "network-vif-deleted", "tag": "4478aeb3-30cc-4a4e-9707-bb149198bb14"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:53.419589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-18fe6621-732d-4432-bee8-761e8878219b req-fb657581-96d8-440e-b5d5-a2d13b9f4fc9 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:53.420164 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-18fe6621-732d-4432-bee8-761e8878219b req-fb657581-96d8-440e-b5d5-a2d13b9f4fc9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:53.420668 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-18fe6621-732d-4432-bee8-761e8878219b req-fb657581-96d8-440e-b5d5-a2d13b9f4fc9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:53.430914 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:53.431655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:53.435315 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-18fe6621-732d-4432-bee8-761e8878219b req-fb657581-96d8-440e-b5d5-a2d13b9f4fc9 service nova] Creating event network-vif-deleted:4478aeb3-30cc-4a4e-9707-bb149198bb14 for instance 85d36039-930c-4f96-93c3-c9fb893ae77c on hv-cinder-85625 Sep 08 16:11:53.441181 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-18fe6621-732d-4432-bee8-761e8878219b req-fb657581-96d8-440e-b5d5-a2d13b9f4fc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037288 Sep 08 16:11:53.442164 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 291/554] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:11:53.445341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:53.450935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:53.451660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:53.452584 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:53.453046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:53.453475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:53.616827 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:53.624270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6cb8b4a3-ebaf-4649-b325-74a276bcd147 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.205789 Sep 08 16:11:53.624944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 264/555] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:53 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:53.895035 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:53.895903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:53.902386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:53.902932 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:53.903372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:53.904108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:53.904560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:53.905215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:53.941726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:53.942338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:53.942887 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:53.943409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lazy-loading 'fault' on Instance uuid 85d36039-930c-4f96-93c3-c9fb893ae77c {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:11:53.988620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:53.996489 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0e96b7b6-15e1-4710-8c01-4aabbed6c2c4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 200 len: 1330 microversion: 2.1 time: 0.105921 Sep 08 16:11:53.997072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 292/556] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:53 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:54.648591 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:54.649217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:54.656589 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:54.657075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:54.657508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:54.658201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:54.658655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:54.659106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:54.796932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:54.805843 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-337af039-971f-46e1-bc6e-38fc397d9adc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.161264 Sep 08 16:11:54.806418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 265/557] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:54 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:55.020386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:55.021022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:55.027912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:55.028400 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:55.028833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:55.029530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:55.029984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:55.030408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:55.044043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c HTTP/1.1 Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:11:55.045746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:11:55.047276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '85d36039-930c-4f96-93c3-c9fb893ae77c'} Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:11:55.048185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:11:55.049634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:11:55.050913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:11:55.050913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0a685dbc-813e-4ae0-a12b-501ec67a1f92 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 404 len: 111 microversion: 2.1 time: 0.030659 Sep 08 16:11:55.050913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 293/558] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:55 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:11:55.056305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-00e3965a-5455-4392-b4e1-5c18c63fe89c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '.version_select at 0x7f886009a940>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:55.077058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-00e3965a-5455-4392-b4e1-5c18c63fe89c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-672068844" status: 202 len: 0 microversion: 2.1 time: 0.024690 Sep 08 16:11:55.077669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 266/559] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 16:11:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-672068844 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:11:55.723183 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9c4cb7ee-7c4c-4368-a2c6-1dd3e9b418f9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: .version_select at 0x7f8860125040>, body: {"keypair": {"name": "tempest-keypair-1568815663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAjmTiXQclP/vmlm1n+ONKJ9r7eIAuyQumW2Br+h4qZ7pxiHSRsurt/jQMg/n2/3qWZuVRIsv6Cq1J/pLJV2U5reUS3SXFmcPJF66sYlJxMtyf+t5b+JwhBn7Qttc2htA=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:55.739601 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-9c4cb7ee-7c4c-4368-a2c6-1dd3e9b418f9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:11:55.744054 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-9c4cb7ee-7c4c-4368-a2c6-1dd3e9b418f9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:11:55.769390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9c4cb7ee-7c4c-4368-a2c6-1dd3e9b418f9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050060 Sep 08 16:11:55.769995 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 294/560] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:11:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:11:55.835630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:55.836267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:55.843240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:55.843798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:55.844223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:55.845187 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:55.845860 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:55.846519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:56.038692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:56.047657 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-98500de1-145c-4390-b7c3-cadaad11322e tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.216733 Sep 08 16:11:56.048633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 267/561] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:55 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:57.073750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:57.074386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:57.082197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:57.082688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:57.083115 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:57.083857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:57.084308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:57.084726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:57.226494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:57.235538 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-70960821-6fcb-48e3-964f-772535b122df tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.166412 Sep 08 16:11:57.236118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 295/562] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:57 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:57.445083 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1940021106", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a88764e-b620-4723-a684-b37f114bda88"}], "security_groups": [{"name": "tempest-securitygroup--2036049229"}], "key_name": "tempest-keypair-1568815663", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:11:57.455797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:11:57.552013 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] validate_networks() for [('2a88764e-b620-4723-a684-b37f114bda88', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:11:57.939107 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:11:57.939712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:11:57.940392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:11:57.941294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:11:57.941891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:11:57.952075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:57.952548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:57.952973 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:57.953680 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:57.954122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:57.954535 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:57.971793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:11:57.975682 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:11:57.987180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:11:57.989540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:11:58.037011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-64af6440-de1f-43af-a55b-cb8655c41235 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597201 Sep 08 16:11:58.037773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 268/563] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:11:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:11:58.049830 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3d6da4b3-5271-4d08-ab23-58e6d7af274b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:58.050445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3d6da4b3-5271-4d08-ab23-58e6d7af274b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:58.103953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d6da4b3-5271-4d08-ab23-58e6d7af274b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:58.110892 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3d6da4b3-5271-4d08-ab23-58e6d7af274b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1242 microversion: 2.1 time: 0.065119 Sep 08 16:11:58.111516 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 296/564] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:58 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:58.260244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:58.260854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:58.268170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:58.268656 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:58.269112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:58.270021 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:58.270562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:58.271065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:58.408931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:58.418393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9fb09141-454c-47fc-b8ad-433b66b8c189 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.162291 Sep 08 16:11:58.418947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 269/565] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:58 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:59.135119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:59.136270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:59.148511 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:59.149324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:59.150028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:59.151086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:59.151912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:59.152640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:59.218782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:59.226900 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-60f677e2-f558-43fe-9dc4-5db666257611 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1294 microversion: 2.1 time: 0.096951 Sep 08 16:11:59.227542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 297/566] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:59 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:11:59.446340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:11:59.449592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:11:59.457780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:59.458278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:59.458714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:59.459519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:11:59.460002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:11:59.460634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:11:59.644421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:11:59.652867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d5e3eee9-4562-426a-b202-faa665353b95 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.211961 Sep 08 16:11:59.653436 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 270/567] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:11:59 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:00.249497 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:00.250113 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:00.256926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:00.257415 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:00.257847 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:00.258545 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:00.258999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:00.259416 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:00.424343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:00.436504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a0fbc7c4-5ba9-418f-8ebf-bea252e08909 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.190931 Sep 08 16:12:00.441816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 298/568] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:00 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:00.675980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:00.676863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:00.684118 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:00.684621 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:00.685074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:00.685824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:00.686279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:00.686720 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:00.887577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:00.896179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-efbbd94d-f0b1-44e7-ad59-b9bd06503ffc tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.224180 Sep 08 16:12:00.896751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 271/569] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:00 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:01.027676 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-82b86078-5144-4eb1-8992-2d44f5e44d51 req-462625ef-9fc9-4197-96ff-6b8227fd255e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52645e54-6325-4fb6-a2d5-20a2331a135a", "tag": "fec67c39-eccc-4e78-970a-671ae7551ae2"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:01.037282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-82b86078-5144-4eb1-8992-2d44f5e44d51 req-462625ef-9fc9-4197-96ff-6b8227fd255e service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:01.038013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-82b86078-5144-4eb1-8992-2d44f5e44d51 req-462625ef-9fc9-4197-96ff-6b8227fd255e service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:01.038607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-82b86078-5144-4eb1-8992-2d44f5e44d51 req-462625ef-9fc9-4197-96ff-6b8227fd255e service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:01.050896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-82b86078-5144-4eb1-8992-2d44f5e44d51 req-462625ef-9fc9-4197-96ff-6b8227fd255e service nova] Creating event network-changed:fec67c39-eccc-4e78-970a-671ae7551ae2 for instance 52645e54-6325-4fb6-a2d5-20a2331a135a on hv-cinder-85625 Sep 08 16:12:01.056261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-82b86078-5144-4eb1-8992-2d44f5e44d51 req-462625ef-9fc9-4197-96ff-6b8227fd255e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032357 Sep 08 16:12:01.056859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 299/570] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:01.468082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:01.469082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:01.478124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:01.478622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:01.479046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:01.479841 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:01.480317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:01.480723 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:01.484692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:01.684626 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:01.693034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e7fa9b62-f89d-44b2-a791-faec774480d5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.231512 Sep 08 16:12:01.693628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 272/571] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:01 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:01.925615 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:01.926733 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:01.934314 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:01.934687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:01.935118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:01.935833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:01.936284 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:01.936703 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:02.069795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:02.078251 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9a0fde53-2b57-4d51-999b-84a47f84046c tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.160581 Sep 08 16:12:02.078856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 300/572] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:01 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:02.718007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:02.718613 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:02.726276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:02.726816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:02.727293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:02.728091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:02.728594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:02.729071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:02.873092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:02.881411 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2951b16d-0231-49a8-846e-068187e32a1d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.167808 Sep 08 16:12:02.882111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 273/573] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:02 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:03.104170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:03.104743 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:03.111846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:03.112478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:03.112908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:03.113606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:03.114057 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:03.114476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:03.248916 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:03.257644 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3c6f616a-5e73-48ab-adb0-e0897d120a83 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.158212 Sep 08 16:12:03.258322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 301/574] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:03 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:03.903929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:03.904538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:03.911223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:03.911730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:03.912160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:03.912835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:03.913397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:03.913815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:04.130903 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:04.139468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-56ac94dc-efc6-43d3-8c34-fad3e2889e9c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.239467 Sep 08 16:12:04.140086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 274/575] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:03 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:04.281151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:04.281816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:04.290109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:04.290583 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:04.291010 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:04.292365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:04.292821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:04.293404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:04.297839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:04.426905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:04.435730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fdb7e81e-e225-48d3-9580-a2c7fe9aed41 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.158799 Sep 08 16:12:04.436282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 302/576] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:04 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:04.586161 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1585604319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-261248473", "security_groups": [{"name": "tempest-secgroup-smoke-2135252370"}], "networks": [{"uuid": "66a0a816-43e7-4c9c-bf87-fdfe77a891f4"}], "block_device_mapping_v2": [{"uuid": "65ecf2b2-477c-4eed-84d0-ce0e2b248c6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:04.711508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] validate_networks() for [('66a0a816-43e7-4c9c-bf87-fdfe77a891f4', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:12:05.080238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:12:05.080852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:12:05.081219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:12:05.081805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:12:05.082370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:12:05.092608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:05.093088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:05.093510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:05.094222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:05.094672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:05.095091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:05.112249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Getting quotas for project 2245b7557087417bb8a32322c8673cef. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:12:05.116527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Getting quotas for user f3be588325bf40beae354c1237d8e9ea and project 2245b7557087417bb8a32322c8673cef. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:12:05.165203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:05.165853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:05.172320 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:05.172809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:05.173237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:05.173933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:05.174397 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:05.174818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:05.178601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:12:05.180806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65ecf2b2-477c-4eed-84d0-ce0e2b248c6f',volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:12:05.315266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:05.323857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2906414a-7005-42e9-8e14-51b26a0ba677 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.162718 Sep 08 16:12:05.324669 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 303/577] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:05 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:05.342257 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-20e73e82-3428-4f5c-a83d-8672b1a1c69e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760129 Sep 08 16:12:05.342982 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 275/578] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:12:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:12:05.354273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-44b5ea17-a70f-485c-b48c-f0476cc76c69 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:05.355143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-44b5ea17-a70f-485c-b48c-f0476cc76c69 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:05.412184 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-44b5ea17-a70f-485c-b48c-f0476cc76c69 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:05.419052 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-44b5ea17-a70f-485c-b48c-f0476cc76c69 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1088 microversion: 2.1 time: 0.068758 Sep 08 16:12:05.419642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 304/579] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:05 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:05.459711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:05.460391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:05.466467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:05.466914 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:05.467299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:05.468172 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:05.468496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:05.468931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:05.610987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:05.619714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6354c1fc-392e-4003-a71e-44d63333f882 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.163908 Sep 08 16:12:05.620420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 276/580] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:05 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:06.350403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:06.351422 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:06.362450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.363249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.364097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.365242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.365996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.366641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.441751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:06.442298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:06.451104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.451814 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.452461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.453238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.453762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.454257 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.498319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:06.506143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7708534f-085a-452a-ba7c-3d9ebabb91bd tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.162253 Sep 08 16:12:06.506707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 305/581] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:06 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:06.516479 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:06.525105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bc1ae874-df6f-440d-95ac-2a158b90510b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1186 microversion: 2.1 time: 0.087762 Sep 08 16:12:06.525668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 277/582] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:06 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:06.642441 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:06.643050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:06.649318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.649806 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.650263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.650932 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.651383 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.651865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.798231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:06.807260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2ac86d36-0461-4e9a-810f-07bc9f925489 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.168658 Sep 08 16:12:06.811684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 306/583] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:06 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:06.909480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-330911bb-e74e-493c-be99-91eed23a7e0a req-328795cc-0813-40f1-b197-ee286e6a3ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52645e54-6325-4fb6-a2d5-20a2331a135a", "name": "network-vif-plugged", "status": "completed", "tag": "fec67c39-eccc-4e78-970a-671ae7551ae2"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:06.919649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-330911bb-e74e-493c-be99-91eed23a7e0a req-328795cc-0813-40f1-b197-ee286e6a3ea9 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:06.920350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-330911bb-e74e-493c-be99-91eed23a7e0a req-328795cc-0813-40f1-b197-ee286e6a3ea9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:06.920765 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-330911bb-e74e-493c-be99-91eed23a7e0a req-328795cc-0813-40f1-b197-ee286e6a3ea9 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:06.935902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-330911bb-e74e-493c-be99-91eed23a7e0a req-328795cc-0813-40f1-b197-ee286e6a3ea9 service nova] Creating event network-vif-plugged:fec67c39-eccc-4e78-970a-671ae7551ae2 for instance 52645e54-6325-4fb6-a2d5-20a2331a135a on hv-cinder-85625 Sep 08 16:12:06.941588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-330911bb-e74e-493c-be99-91eed23a7e0a req-328795cc-0813-40f1-b197-ee286e6a3ea9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035781 Sep 08 16:12:06.942410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 278/584] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:07.532472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:07.534223 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:07.542213 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:07.542976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:07.543646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:07.544578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:07.544997 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:07.545414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:07.550470 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:07.551185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:07.561796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:07.562449 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:07.563279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:07.564023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:07.564484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:07.564902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:07.694156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:07.702338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-27136e77-a191-422a-a60d-d7ff1f0dd6e4 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.175501 Sep 08 16:12:07.715677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 307/585] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:07 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:07.830598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:07.831312 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:07.838213 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:07.838727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:07.839230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:07.840018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:07.840477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:07.840900 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:07.980567 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:07.989539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a0632b37-23ec-4069-8e17-65a75c30fa11 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.162906 Sep 08 16:12:07.990119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 308/586] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:07 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:08.090468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:08.098616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3adf93bd-3f9a-4ca3-a6fd-bfb19fbe0d44 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1272 microversion: 2.1 time: 0.553403 Sep 08 16:12:08.099195 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 279/587] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:07 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1272 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:08.524664 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-c3d287b6-fa9a-4d9a-84fa-9d732490b300 req-ae3155a8-8f56-4084-bb8f-f43ba95c2d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:08.534186 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c3d287b6-fa9a-4d9a-84fa-9d732490b300 req-ae3155a8-8f56-4084-bb8f-f43ba95c2d77 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:08.534802 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c3d287b6-fa9a-4d9a-84fa-9d732490b300 req-ae3155a8-8f56-4084-bb8f-f43ba95c2d77 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:08.535065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c3d287b6-fa9a-4d9a-84fa-9d732490b300 req-ae3155a8-8f56-4084-bb8f-f43ba95c2d77 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:08.548239 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-c3d287b6-fa9a-4d9a-84fa-9d732490b300 req-ae3155a8-8f56-4084-bb8f-f43ba95c2d77 service nova] Creating event network-changed:ad971a2b-7909-43cc-ae5d-c8907276f5de for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 on hv-cinder-85625 Sep 08 16:12:08.552867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-c3d287b6-fa9a-4d9a-84fa-9d732490b300 req-ae3155a8-8f56-4084-bb8f-f43ba95c2d77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032046 Sep 08 16:12:08.553454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 309/588] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:08.726545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:08.727115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:08.734412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:08.734922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:08.735384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:08.736135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:08.736616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:08.737059 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:08.874919 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:08.882878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5f52174c-ef20-4606-a806-4e0827b0b135 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1368 microversion: 2.1 time: 0.160622 Sep 08 16:12:08.883467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 280/589] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:08 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:09.018397 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:09.019419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:09.029799 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:09.030583 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:09.031289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:09.032455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:09.033210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:09.033898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:09.121867 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:09.122477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:09.128860 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:09.129345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:09.129783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:09.130507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:09.130955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:09.131380 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:09.170873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:09.179372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5c1a5375-8890-4de7-b74f-04f7b54acd43 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.168273 Sep 08 16:12:09.179988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 310/590] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:09 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:09.265542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:09.273674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-00ed9289-0fff-4da3-88dd-3bbef29118c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.155663 Sep 08 16:12:09.274253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 281/591] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:09 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:09.910625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:09.911483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:09.919476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:09.919976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:09.920426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:09.921102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:09.921549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:09.921971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.053074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:10.061591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0b7a8125-6065-4df9-b5c0-06fb3b3a5def tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1559 microversion: 2.1 time: 0.157757 Sep 08 16:12:10.062163 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 311/592] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:09 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:10.093682 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:10.094261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:10.101261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:10.101726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:10.102157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.102875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:10.103333 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:10.103786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.180892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e5f6e86b-bf2e-47f0-9c60-d957785a4eae tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091236 Sep 08 16:12:10.181562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 282/593] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:12:10 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:10.202519 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:10.203130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:10.209443 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:10.209935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:10.210374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.211111 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:10.211608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:10.212033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.296743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:10.297555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:10.304086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:10.304762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:10.306173 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.306976 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:10.308345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:10.308868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:10.351962 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:10.360623 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fb98b9c6-4fc1-4b6e-adb5-99a0c47bc103 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.161980 Sep 08 16:12:10.361256 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 312/594] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:10 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:10.716605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:10.724962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-508da3cb-fb08-48dc-96e8-c6cb4c54dac3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.432239 Sep 08 16:12:10.725533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 283/595] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:10 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:12:11.384514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:11.385361 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:11.392063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:11.392548 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:11.392978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:11.393666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:11.394093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:11.394541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:11.534004 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:11.542444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dde0bec9-fc53-42fa-98a0-5223bccd7900 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1736 microversion: 2.1 time: 0.162157 Sep 08 16:12:11.543028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 313/596] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:11 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:11.747866 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:11.748426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:11.755543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:11.756042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:11.756501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:11.757218 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:11.757674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:11.758098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:11.999949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-97776d4b-37fd-4ac5-bc26-326b5ebda67e req-7fc9b8a7-42e9-45c8-9ed3-3a202d91a479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52645e54-6325-4fb6-a2d5-20a2331a135a", "tag": "fec67c39-eccc-4e78-970a-671ae7551ae2"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:12.005704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:12.012441 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-97776d4b-37fd-4ac5-bc26-326b5ebda67e req-7fc9b8a7-42e9-45c8-9ed3-3a202d91a479 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:12.012927 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-97776d4b-37fd-4ac5-bc26-326b5ebda67e req-7fc9b8a7-42e9-45c8-9ed3-3a202d91a479 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:12.013373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-97776d4b-37fd-4ac5-bc26-326b5ebda67e req-7fc9b8a7-42e9-45c8-9ed3-3a202d91a479 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:12.016151 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:12.024760 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c6a59b9b-06fc-4785-8048-1b5c01511e7e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.280678 Sep 08 16:12:12.025622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 284/597] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:11 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:12.026740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-97776d4b-37fd-4ac5-bc26-326b5ebda67e req-7fc9b8a7-42e9-45c8-9ed3-3a202d91a479 service nova] Creating event network-changed:fec67c39-eccc-4e78-970a-671ae7551ae2 for instance 52645e54-6325-4fb6-a2d5-20a2331a135a on hv-cinder-85625 Sep 08 16:12:12.040212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-97776d4b-37fd-4ac5-bc26-326b5ebda67e req-7fc9b8a7-42e9-45c8-9ed3-3a202d91a479 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044277 Sep 08 16:12:12.040818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 314/598] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:12.567551 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:12.569041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:12.577802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:12.578510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:12.579191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:12.580116 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:12.580814 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:12.581532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:12.913019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:12.921836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4dc520ab-c8ec-48ec-8748-0e58d130260b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1716 microversion: 2.1 time: 0.359535 Sep 08 16:12:12.938325 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 285/599] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:12 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1716 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:13.051677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:13.052547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:13.058760 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:13.059250 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:13.059468 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.059973 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.060418 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.061139 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.061589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.062203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.065773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.066446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.066873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.067928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.068640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.069132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.164856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] HTTP exception thrown: Cannot 'detach_volume' instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 while it is in vm_state rescued Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Request method failure captured: Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments/eebc1e1a-27eb-4b19-a318-9136cf085364 HTTP/1.1 Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNoFW1fgwP5T-ivL1vEtVb4Xaznb9dG5A0WWMjHfg8Fpra-s-xxYZh7-tMiHLTO_DjEJytNHYcDiylJiWewzjGu0mAG8LXLmfm15CD6Qhbg2P7SRIHOUDznqLmi_eUI0BZh1Q5KELX0YJjKFlF3bLDOKR_PftJIwT9izYmT6Bg7bHA Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:12:13.167897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73c9cf0f579144eb80c090456d363a05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}] Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 18375266a64348df879a9eec53bfcbf9 Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:12:13.169270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Cannot 'detach_volume' instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 while it is in vm_state rescued Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'server_id': 'b43a6d26-3e4a-4fde-8461-ad70b4e96a46', 'id': 'eebc1e1a-27eb-4b19-a318-9136cf085364'} Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:12:13.169941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 while it is in vm_state rescued Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 while it is in vm_state rescued Sep 08 16:12:13.171135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:12:13.173586 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Returning 409 to user: Cannot 'detach_volume' instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 while it is in vm_state rescued {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:12:13.174699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6506e824-d88d-4806-abd7-d4e283a57620 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments/eebc1e1a-27eb-4b19-a318-9136cf085364" status: 409 len: 152 microversion: 2.1 time: 0.120391 Sep 08 16:12:13.175398 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 286/600] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:12:13 2022] DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments/eebc1e1a-27eb-4b19-a318-9136cf085364 => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 16:12:13.184227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:13.185414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:13.192399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.192988 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.193518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.194285 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.194797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.195548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.231792 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:13.248005 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5918aa5-a228-45e7-b740-f0a59d765567 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.201471 Sep 08 16:12:13.251617 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 315/601] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:13 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:13.284115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0c263d24-47c2-49e9-99bc-213e5fb856ec tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "POST /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/action" status: 202 len: 0 microversion: 2.1 time: 0.103559 Sep 08 16:12:13.287881 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 287/602] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:12:13 2022] POST /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:12:13.293288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:13.293889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:13.301876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.302323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.302833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.303565 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:13.304015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:13.304553 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:13.454939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:13.463585 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b6944be9-188c-483a-94eb-7bdf57504dcf tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1724 microversion: 2.1 time: 0.174109 Sep 08 16:12:13.464157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 316/603] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:13 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:14.276213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:14.277365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:14.287799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:14.288587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:14.289199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:14.289876 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:14.290333 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:14.290736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:14.425825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:14.433855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4e46993f-8271-4f8b-97c7-20f83b7f06e1 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.165704 Sep 08 16:12:14.434577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 288/604] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:14 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:14.486368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:14.486902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:14.493899 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:14.494387 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:14.494822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:14.495547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:14.496006 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:14.496434 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:14.635140 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:14.643667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c89d5701-3578-4368-898c-a3dbf91a1c34 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1724 microversion: 2.1 time: 0.161194 Sep 08 16:12:14.644244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 317/605] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:14 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:15.461678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:15.462718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:15.465526 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:15.466164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=12 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:15.472997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:15.473480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:15.473903 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:15.474579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:15.475054 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:15.475464 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:15.494242 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:15.617317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:15.625445 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-83709439-3677-444a-b583-5f2987734e86 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.170820 Sep 08 16:12:15.626023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 289/606] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:15 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:15.667197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:15.667833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:15.669897 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=8 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:15.675824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:15.676309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:15.676756 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:15.677449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:15.677896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:15.678321 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:15.813075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:15.821797 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7bf2ef9f-452e-4c59-ac82-98b19ea857a0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1724 microversion: 2.1 time: 0.158700 Sep 08 16:12:15.822368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 318/607] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:15 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:16.341964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:16.342454 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:16.349147 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:16.349635 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:16.350072 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:16.350756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:16.351207 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:16.351667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:16.435178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lazy-loading 'services' on Instance uuid 3328192d-87f0-46fe-97e1-57559cb1318b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:12:16.510562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9dcd76c7-640e-4ab0-a086-c298b3b98506 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-volume_attachments/338d317e-fce8-4992-9844-092e831df2b9" status: 202 len: 0 microversion: 2.1 time: 0.172355 Sep 08 16:12:16.511207 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 290/608] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:12:16 2022] DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-volume_attachments/338d317e-fce8-4992-9844-092e831df2b9 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:12:16.648404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:16.649168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:16.657643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:16.658329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:16.659106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:16.659955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:16.660518 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:16.661033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:16.793371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:16.801331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ab437c89-a890-40ba-a670-85d3ffb6be13 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.156944 Sep 08 16:12:16.801905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 319/609] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:16 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:16.845848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:16.846552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:16.853253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:16.853735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:16.854219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:16.854905 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:16.855377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:16.857846 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:16.991200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:16.999816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a560e062-796e-4e05-9811-9e254cfeb271 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1730 microversion: 2.1 time: 0.158321 Sep 08 16:12:17.000386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 291/610] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:16 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:17.023120 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:17.023751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:17.030298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.030774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.031200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.031930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.032373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.032790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.117777 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5b941f4e-6900-4ba9-9319-fd75305ab05f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098640 Sep 08 16:12:17.118461 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 320/611] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:12:17 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:17.632304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9a62a69c-b684-4da7-bdd9-8137e90cbab9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:17.639399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a62a69c-b684-4da7-bdd9-8137e90cbab9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.639912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a62a69c-b684-4da7-bdd9-8137e90cbab9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.640508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9a62a69c-b684-4da7-bdd9-8137e90cbab9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.663324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9a62a69c-b684-4da7-bdd9-8137e90cbab9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Going to try to stop instance {{(pid=120782) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 16:12:17.709603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9a62a69c-b684-4da7-bdd9-8137e90cbab9 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action" status: 202 len: 0 microversion: 2.1 time: 0.081094 Sep 08 16:12:17.710203 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 292/612] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:12:17 2022] POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:12:17.718884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:17.719523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:17.725666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.726136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.726613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.727484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.727879 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.728274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.746691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:17.825298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:17.826063 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:17.832641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.833431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.834158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.834911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:17.835389 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:17.835997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:17.868679 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:17.876864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ff1a1763-204f-4fba-95b0-7547a3f835ae tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.162308 Sep 08 16:12:17.877496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 321/613] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:17 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:18.070967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:18.079114 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-797eeeaa-1796-4988-9fff-a2e93609af52 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.258193 Sep 08 16:12:18.079905 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 293/614] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:17 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:18.087720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-0062dc2b-9bfb-4980-b3ef-80dfec2319e6 req-6f91db28-f4a4-47c7-889a-851213ad6664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43a6d26-3e4a-4fde-8461-ad70b4e96a46", "tag": "a2422c6e-ed88-4508-ab49-226147c59fb9"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:18.097258 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-0062dc2b-9bfb-4980-b3ef-80dfec2319e6 req-6f91db28-f4a4-47c7-889a-851213ad6664 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:18.098371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-0062dc2b-9bfb-4980-b3ef-80dfec2319e6 req-6f91db28-f4a4-47c7-889a-851213ad6664 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:18.098873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-0062dc2b-9bfb-4980-b3ef-80dfec2319e6 req-6f91db28-f4a4-47c7-889a-851213ad6664 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:18.111424 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-0062dc2b-9bfb-4980-b3ef-80dfec2319e6 req-6f91db28-f4a4-47c7-889a-851213ad6664 service nova] Creating event network-changed:a2422c6e-ed88-4508-ab49-226147c59fb9 for instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 on hv-cinder-85625 Sep 08 16:12:18.116355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-0062dc2b-9bfb-4980-b3ef-80dfec2319e6 req-6f91db28-f4a4-47c7-889a-851213ad6664 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033806 Sep 08 16:12:18.116958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 322/615] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:18.901016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:18.901847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:18.908775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:18.909251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:18.909824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:18.910367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:18.910815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:18.911638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:19.044513 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:19.052508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fb92a2f3-ee54-4aaf-b731-0960f7043705 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.155469 Sep 08 16:12:19.053054 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 294/616] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:18 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:19.103214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:19.103930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:19.110820 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:19.111297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:19.111769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:19.112455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:19.112941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:19.113360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:19.245847 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:19.253796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d88b3dcb-fc76-4ceb-99f1-d533f539ce12 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.155368 Sep 08 16:12:19.254354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 323/617] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:19 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:20.082241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:20.083349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:20.094350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:20.095130 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:20.095955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:20.097102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:20.097877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:20.098632 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:20.131276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-59a8a0a3-aaf0-462b-8034-2c1879eab05e req-d7220b03-22e8-4557-8411-7a292c4f39a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43a6d26-3e4a-4fde-8461-ad70b4e96a46", "tag": "a2422c6e-ed88-4508-ab49-226147c59fb9"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:20.141576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-59a8a0a3-aaf0-462b-8034-2c1879eab05e req-d7220b03-22e8-4557-8411-7a292c4f39a3 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:20.142013 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-59a8a0a3-aaf0-462b-8034-2c1879eab05e req-d7220b03-22e8-4557-8411-7a292c4f39a3 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:20.142648 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-59a8a0a3-aaf0-462b-8034-2c1879eab05e req-d7220b03-22e8-4557-8411-7a292c4f39a3 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:20.157851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-59a8a0a3-aaf0-462b-8034-2c1879eab05e req-d7220b03-22e8-4557-8411-7a292c4f39a3 service nova] Creating event network-changed:a2422c6e-ed88-4508-ab49-226147c59fb9 for instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 on hv-cinder-85625 Sep 08 16:12:20.164722 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-59a8a0a3-aaf0-462b-8034-2c1879eab05e req-d7220b03-22e8-4557-8411-7a292c4f39a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036930 Sep 08 16:12:20.165510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 324/618] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:20.277532 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:20.278237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:20.284796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:20.285309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:20.285730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:20.286409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:20.286856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:20.287273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:20.299188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:20.308008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8dc0fede-b031-443f-a523-4182241122fe tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.232452 Sep 08 16:12:20.308860 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 295/619] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:20 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:20.419624 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:20.427633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5acdb651-7b38-47e3-a0df-1d9e7e29dae0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.154343 Sep 08 16:12:20.428219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 325/620] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:20 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:21.336762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:21.337819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:21.340930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:21.346798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:21.347270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:21.347777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:21.348490 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:21.348964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:21.349384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:21.450573 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:21.451135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:21.457967 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:21.458797 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:21.460212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:21.461344 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:21.461613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:21.462060 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:21.490795 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:21.499098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-dd87cd33-1b31-453e-b154-796e0124a4bd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.169089 Sep 08 16:12:21.500066 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 296/621] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:21 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:21.603753 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:21.612346 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-949deb9b-6481-4768-bdbb-21dc23996037 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.165751 Sep 08 16:12:21.613078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 326/622] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:21 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:22.526899 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:22.527942 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:22.538968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:22.539831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:22.540546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:22.541674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:22.542389 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:22.542848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:22.636791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:22.637540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:22.645374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:22.645856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:22.646317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:22.647022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:22.647487 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:22.647916 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:22.687060 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:22.695328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5fe9d4f6-cc5c-49e0-8031-f5eae03a01d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.174879 Sep 08 16:12:22.695935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 297/623] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:22 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:22.780058 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:22.790307 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6cadfaf6-8159-4d7c-a675-c2cc1b00c5c4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.158492 Sep 08 16:12:22.791039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 327/624] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:22 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:22.991124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-6400d968-68d5-4bd0-95c7-aeb9a1177fd1 req-e3debaf2-d1d3-46aa-a526-09d6f8534b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "name": "network-vif-plugged", "status": "completed", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:23.001749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6400d968-68d5-4bd0-95c7-aeb9a1177fd1 req-e3debaf2-d1d3-46aa-a526-09d6f8534b8f service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:23.002425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6400d968-68d5-4bd0-95c7-aeb9a1177fd1 req-e3debaf2-d1d3-46aa-a526-09d6f8534b8f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:23.002951 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6400d968-68d5-4bd0-95c7-aeb9a1177fd1 req-e3debaf2-d1d3-46aa-a526-09d6f8534b8f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:23.015382 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-6400d968-68d5-4bd0-95c7-aeb9a1177fd1 req-e3debaf2-d1d3-46aa-a526-09d6f8534b8f service nova] Creating event network-vif-plugged:ad971a2b-7909-43cc-ae5d-c8907276f5de for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 on hv-cinder-85625 Sep 08 16:12:23.020747 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-6400d968-68d5-4bd0-95c7-aeb9a1177fd1 req-e3debaf2-d1d3-46aa-a526-09d6f8534b8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 Sep 08 16:12:23.021714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 298/625] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:23.719408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:23.720037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:23.726753 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:23.727232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:23.727703 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:23.728388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:23.728842 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:23.729264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:23.814329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:23.815315 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:23.822184 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:23.822929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:23.823486 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:23.824210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:23.824655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:23.825057 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:23.867476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:23.875414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5d346eed-3d85-4759-b051-504783bdfa9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.160026 Sep 08 16:12:23.876006 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 328/626] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:23 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:24.253208 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:24.261269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bf6379e5-0590-40b3-8127-2c3488e4d082 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1260 microversion: 2.1 time: 0.451561 Sep 08 16:12:24.261844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 299/627] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:23 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1260 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:24.903012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:24.903840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:24.912778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:24.913412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:24.913987 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:24.914893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:24.915514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:24.916099 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:25.053159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:25.061338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-be39fa51-5c7b-4de1-9d61-436b6364682a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.164644 Sep 08 16:12:25.061915 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 329/628] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:24 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:25.284150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:25.284713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:25.291975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:25.292465 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:25.292901 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:25.293593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:25.294045 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:25.294471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:25.431844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:25.443713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e67e6800-e083-48f1-8176-9e00dcc5e8d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1444 microversion: 2.1 time: 0.163243 Sep 08 16:12:25.444844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 300/629] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:25 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:12:25.466967 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:25.467600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:25.474402 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:25.474876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:25.475301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:25.476020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:25.476465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:25.476880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:25.638840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:25.650318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-393d335e-3fbb-4c55-b4d4-ed1c554da864 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1444 microversion: 2.1 time: 0.186930 Sep 08 16:12:25.651101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 330/630] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:25 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1444 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:26.085007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:26.085624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:26.091773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:26.092260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:26.092694 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:26.093388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:26.093865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:26.094283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:26.312276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:26.320963 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-19693d56-6e74-4dcf-a3eb-77a8d2dec6c8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.239975 Sep 08 16:12:26.321515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 301/631] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:26 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:27.345919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:27.346496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:27.353216 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.353785 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.354248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:27.355231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.355438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.355926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:27.410753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-9022e669-85a3-42fd-b60f-34b0e869e377 req-3c07ef4e-5757-4add-be09-0db967b5b1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:27.420548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9022e669-85a3-42fd-b60f-34b0e869e377 req-3c07ef4e-5757-4add-be09-0db967b5b1a6 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.421101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9022e669-85a3-42fd-b60f-34b0e869e377 req-3c07ef4e-5757-4add-be09-0db967b5b1a6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.421599 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-9022e669-85a3-42fd-b60f-34b0e869e377 req-3c07ef4e-5757-4add-be09-0db967b5b1a6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:27.433343 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-9022e669-85a3-42fd-b60f-34b0e869e377 req-3c07ef4e-5757-4add-be09-0db967b5b1a6 service nova] Creating event network-changed:ad971a2b-7909-43cc-ae5d-c8907276f5de for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 on hv-cinder-85625 Sep 08 16:12:27.438333 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-9022e669-85a3-42fd-b60f-34b0e869e377 req-3c07ef4e-5757-4add-be09-0db967b5b1a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032096 Sep 08 16:12:27.439046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 302/632] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:27.489698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:27.498226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cfe4c9bb-9787-4ae8-8065-447290513dbd tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1678 microversion: 2.1 time: 0.156231 Sep 08 16:12:27.499173 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 331/633] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:27 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:27.821092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:27.821815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:27.829251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.829730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.830158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:27.830815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.831483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.832054 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:27.861987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fb8e2c02-9293-42ad-8134-7f74378ccac7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments/fe5ff534-ef77-4312-ad18-b6fa338dc353" status: 200 len: 194 microversion: 2.20 time: 0.045471 Sep 08 16:12:27.862876 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 303/634] 10.222.0.27 () {60 vars in 1454 bytes} [Thu Sep 8 16:12:27 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments/fe5ff534-ef77-4312-ad18-b6fa338dc353 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:12:27.931988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:27.932576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:27.938651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.939131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.939582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:27.940698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:27.941077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:27.941493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.024674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lazy-loading 'services' on Instance uuid b86196fd-45b1-4137-abe6-0dcea457440c {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:12:28.111052 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-13227545-bba4-4c4b-b8ed-cfc2af852907 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments/fe5ff534-ef77-4312-ad18-b6fa338dc353" status: 202 len: 0 microversion: 2.20 time: 0.182909 Sep 08 16:12:28.111704 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 332/635] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 8 16:12:27 2022] DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments/fe5ff534-ef77-4312-ad18-b6fa338dc353 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:12:28.120967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:28.123535 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:28.131648 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.132455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.133150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.134288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.134947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.135699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.172961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-601aa452-1142-4605-a863-660fb87e0747 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056329 Sep 08 16:12:28.173714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 304/636] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 16:12:28 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 16:12:28.525755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:28.526462 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:28.532811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.533295 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.533723 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.534417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.534863 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.535626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.667366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:28.675355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c33ccb26-985b-4c73-b01c-2efea821bff5 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1655 microversion: 2.1 time: 0.154538 Sep 08 16:12:28.675951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 333/637] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:28 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:28.699651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6622c5d9-9e82-44ef-b7ee-984ec6e0c080 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:28.706549 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6622c5d9-9e82-44ef-b7ee-984ec6e0c080 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.707031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6622c5d9-9e82-44ef-b7ee-984ec6e0c080 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.707606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6622c5d9-9e82-44ef-b7ee-984ec6e0c080 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.732268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6622c5d9-9e82-44ef-b7ee-984ec6e0c080 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Going to try to start instance {{(pid=120782) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 16:12:28.736555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:28.777561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6622c5d9-9e82-44ef-b7ee-984ec6e0c080 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action" status: 202 len: 0 microversion: 2.1 time: 0.082799 Sep 08 16:12:28.778116 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 305/638] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:12:28 2022] POST /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:12:28.786498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:28.787137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:28.793156 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.793663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.794090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.794760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:28.795201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:28.795640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:28.934054 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:28.942383 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6f951db5-8763-4ed2-aef1-1daff59ed835 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1664 microversion: 2.1 time: 0.159770 Sep 08 16:12:28.943090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 334/639] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:28 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:29.187097 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:29.189440 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:29.196334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.196816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.197248 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.197984 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.198497 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.199048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.230661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8999b589-b0c2-4cc2-8a7a-84ac4d89ae85 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047935 Sep 08 16:12:29.231267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 306/640] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 16:12:29 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:29.308286 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:29.308772 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:29.315250 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.315746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.316171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.316840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.317284 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.317692 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.342638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:12:29.423033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a120b4c5-7d3b-4134-b07a-a9582de99b3d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 204 len: 0 microversion: 2.20 time: 0.118419 Sep 08 16:12:29.424300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 335/641] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 16:12:29 2022] DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:12:29.432509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:29.433411 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:29.439997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.440429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.440849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.441537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.441983 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.442400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.578864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:29.589569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:29.591024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:29.592287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eee17489-86af-4c8a-bee4-666afdd65c6d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.163787 Sep 08 16:12:29.592791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 307/642] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:29 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:29.973725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:29.974679 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:29.983310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.983829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.984262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:29.984951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:29.985403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:29.985822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:30.124748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:30.133137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cac6d7f6-4a61-44df-8978-c4f822405427 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1664 microversion: 2.1 time: 0.166737 Sep 08 16:12:30.133684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 336/643] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:29 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:30.620211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:30.620816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:30.630156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:30.630643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:30.631078 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:30.631813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:30.632270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:30.632699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:30.776101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:30.788363 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:30.790509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:30.792233 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-362b9799-c121-40e0-b6ca-df69285e9554 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1722 microversion: 2.20 time: 0.177530 Sep 08 16:12:30.792801 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 308/644] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:30 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:31.157139 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:31.157761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:31.164482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:31.164962 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:31.165405 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:31.166074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:31.166523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:31.166943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:31.171040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:31.305841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:31.313739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4c2ce090-e772-4c26-95b2-62139ba235de tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1664 microversion: 2.1 time: 0.160580 Sep 08 16:12:31.314330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 337/645] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:31 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:31.818460 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:31.819041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:31.825678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:31.826167 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:31.826597 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:31.827289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:31.827768 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:31.828190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:31.897138 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:31.905978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:31.907424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:31.908627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c42f2e31-2a1e-4dc7-be15-4917b07a087d tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 200 len: 1654 microversion: 2.20 time: 0.094486 Sep 08 16:12:31.909178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 309/646] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:31 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 1654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:12:32.070148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-d2f8a2b6-fe23-47a6-bc35-168e9d249031 req-7102f566-9c26-4dc5-ba7c-75b3fb999949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86196fd-45b1-4137-abe6-0dcea457440c", "name": "network-vif-deleted", "tag": "22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:32.080377 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d2f8a2b6-fe23-47a6-bc35-168e9d249031 req-7102f566-9c26-4dc5-ba7c-75b3fb999949 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:32.080894 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d2f8a2b6-fe23-47a6-bc35-168e9d249031 req-7102f566-9c26-4dc5-ba7c-75b3fb999949 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:32.081243 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d2f8a2b6-fe23-47a6-bc35-168e9d249031 req-7102f566-9c26-4dc5-ba7c-75b3fb999949 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:32.093103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-d2f8a2b6-fe23-47a6-bc35-168e9d249031 req-7102f566-9c26-4dc5-ba7c-75b3fb999949 service nova] Creating event network-vif-deleted:22d36d5f-3fa5-48a6-89d0-ccca5a56c0c6 for instance b86196fd-45b1-4137-abe6-0dcea457440c on hv-cinder-85625 Sep 08 16:12:32.098732 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-d2f8a2b6-fe23-47a6-bc35-168e9d249031 req-7102f566-9c26-4dc5-ba7c-75b3fb999949 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Sep 08 16:12:32.099476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 338/647] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:32.337741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:32.338370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:32.345068 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:32.345941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:32.346520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:32.347378 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:32.347993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:32.348559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:32.497968 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:32.506350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-59a7efae-3a65-4a5f-b34d-0fc5dd80bc9a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1668 microversion: 2.1 time: 0.172373 Sep 08 16:12:32.507049 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 310/648] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:12:32 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:12:32.935492 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:32.936202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:32.943677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:32.944159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:32.944593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:32.945297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:32.945740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:32.946166 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:32.963120 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] HTTP exception thrown: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Request method failure captured: Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c HTTP/1.1 Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNpVgXeu6Hgj34BnSjOSx6x1osSqTLRE1H6klSUD-31cfL0IajPuaKuh5aX_pQ-smt5IyUApsvkFI6LSbS9rWzC7GqsZyJENgki9uoPz9TRlf1suS8WUJEb9knqTqSvTQ77mCD9MhM2vNxSkFSYJB0xgwaLf3Pi5CEz6Q52h3qOFAo Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:12:32.964881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52651960a8b6494193c5e8abc658a2dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}] Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: c89859a30a2442b8ae13fe0444782d9c Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:12:32.966633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'b86196fd-45b1-4137-abe6-0dcea457440c'} Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:12:32.967531 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:12:32.968782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:12:32.970071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Returning 404 to user: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:12:32.970071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a40d4a0d-cb61-4848-bb57-fc34b6490ca5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 404 len: 111 microversion: 2.20 time: 0.035674 Sep 08 16:12:32.970071 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 339/649] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:32 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 16:12:32.976344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f6077f19-3355-4763-8f5d-d72cc1beaa3e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '.version_select at 0x7f88602d68b0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:32.995991 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f6077f19-3355-4763-8f5d-d72cc1beaa3e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412213229" status: 204 len: 0 microversion: 2.20 time: 0.023465 Sep 08 16:12:32.996700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 311/650] 10.222.0.27 () {60 vars in 1262 bytes} [Thu Sep 8 16:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412213229 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:12:33.629073 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1e4e8725-abe2-4af5-8c7a-ad14778f5497 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'create', calling method: .version_select at 0x7f88601524c0>, body: {"keypair": {"name": "tempest-keypair-806062703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4o1+zZWI9AmDzAlKSK3erglqrYDFzmumrddPeg9uY3TTfy0ky+YqdtEFdip5Bp8piev8sAoIscqHFNC38tzaPq+WVIcp+0gCp+3O/c+HU2y4NpvR49vy2nJz1L21mA1A=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:33.644961 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-1e4e8725-abe2-4af5-8c7a-ad14778f5497 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for project 52651960a8b6494193c5e8abc658a2dd. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:12:33.648907 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-1e4e8725-abe2-4af5-8c7a-ad14778f5497 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for user c89859a30a2442b8ae13fe0444782d9c and project 52651960a8b6494193c5e8abc658a2dd. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:12:33.673688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1e4e8725-abe2-4af5-8c7a-ad14778f5497 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048625 Sep 08 16:12:33.674415 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 340/651] 10.222.0.27 () {62 vars in 1200 bytes} [Thu Sep 8 16:12:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 16:12:35.259667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-600565796", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9577f7e-a12c-4f63-bec7-ce8faba76cc5"}], "security_groups": [{"name": "tempest-securitygroup--1089928107"}], "key_name": "tempest-keypair-806062703", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:35.364569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] validate_networks() for [('f9577f7e-a12c-4f63-bec7-ce8faba76cc5', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:12:35.749340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:12:35.749770 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:12:35.750234 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:12:35.750630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:12:35.751034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:12:35.760624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:35.761106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:35.761536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:35.762259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:35.762880 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:35.763293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:35.785613 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for project 52651960a8b6494193c5e8abc658a2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:12:35.789835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Getting quotas for user c89859a30a2442b8ae13fe0444782d9c and project 52651960a8b6494193c5e8abc658a2dd. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:12:35.801492 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:12:35.803889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:12:35.854798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1efaef6f-1f6b-420d-8712-a25e26b4711f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.600131 Sep 08 16:12:35.855469 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 312/652] 10.222.0.27 () {62 vars in 1188 bytes} [Thu Sep 8 16:12:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 16:12:35.867045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1dcea21e-1fb2-4431-9857-84e902f606c0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:35.867673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1dcea21e-1fb2-4431-9857-84e902f606c0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:35.923241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1dcea21e-1fb2-4431-9857-84e902f606c0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:35.931948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1dcea21e-1fb2-4431-9857-84e902f606c0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:35.933321 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1dcea21e-1fb2-4431-9857-84e902f606c0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:35.934481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1dcea21e-1fb2-4431-9857-84e902f606c0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1280 microversion: 2.20 time: 0.071463 Sep 08 16:12:35.935022 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 341/653] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:35 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:36.965130 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:36.966183 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:36.977619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:36.978436 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:36.979166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:36.980383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:36.981125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:36.981554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:37.049672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:37.058301 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:37.059945 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:37.061067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d53c6b22-92df-45c0-9d72-886355befc20 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1332 microversion: 2.20 time: 0.103544 Sep 08 16:12:37.061601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 313/654] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:36 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:38.086612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:38.087224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:38.093881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:38.094351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:38.094778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:38.095475 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:38.095933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:38.096352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:38.229786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:38.238377 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:38.239863 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:38.240989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e20a7a81-bd58-45fc-b0f8-6676e7fafcef tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.158467 Sep 08 16:12:38.241763 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 342/655] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:38 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:38.492421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-27c231a3-cc63-44f1-9188-ae044badfa14 req-f9d36d5a-040f-4c6f-bcde-8b8f4742b94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:38.503792 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-27c231a3-cc63-44f1-9188-ae044badfa14 req-f9d36d5a-040f-4c6f-bcde-8b8f4742b94a service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:38.504272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-27c231a3-cc63-44f1-9188-ae044badfa14 req-f9d36d5a-040f-4c6f-bcde-8b8f4742b94a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:38.504703 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-27c231a3-cc63-44f1-9188-ae044badfa14 req-f9d36d5a-040f-4c6f-bcde-8b8f4742b94a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:38.516163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-27c231a3-cc63-44f1-9188-ae044badfa14 req-f9d36d5a-040f-4c6f-bcde-8b8f4742b94a service nova] Creating event network-changed:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:12:38.521364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-27c231a3-cc63-44f1-9188-ae044badfa14 req-f9d36d5a-040f-4c6f-bcde-8b8f4742b94a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032794 Sep 08 16:12:38.522556 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 314/656] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:39.267464 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:39.268078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:39.274907 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:39.275384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:39.275838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:39.276521 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:39.276965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:39.277384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:39.409663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:39.417887 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:39.419465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:39.420632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9082a1bf-d552-48d2-a543-a7bd1531b588 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.157136 Sep 08 16:12:39.421196 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 343/657] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:39 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:40.447554 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:40.448223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:40.454728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:40.455191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:40.455722 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:40.456415 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:40.456871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:40.457300 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:40.664658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:40.673934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:40.675399 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:40.676562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0c23027e-4668-4ecc-9fa2-7da09aa92d52 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.234032 Sep 08 16:12:40.677141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 315/658] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:40 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:41.704031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:41.704689 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:41.712401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:41.712954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:41.713432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:41.714194 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:41.714725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:41.715257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:41.848408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:41.857101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:41.858523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:41.859657 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-96349d5f-8d89-48a9-b509-aca93273f7f2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.160332 Sep 08 16:12:41.860214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 344/659] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:41 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:42.888868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:42.889538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:42.897223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:42.897766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:42.898257 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:42.899025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:42.899574 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:42.900430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:43.036825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:43.045012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:43.046379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:43.047528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1712e8a0-63ea-4a2c-b558-e0eca75de041 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.165058 Sep 08 16:12:43.048075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 316/660] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:42 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:44.077286 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:44.078244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:44.082144 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:44.091051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:44.091552 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:44.091974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:44.092654 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:44.093097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:44.093510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:44.228923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:44.240240 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:44.242351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:44.244055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9095861b-463b-4318-9e2e-2077c82f7232 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.173054 Sep 08 16:12:44.244831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 345/661] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:44 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:45.102781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-f5992cb7-3fef-4e87-9d25-b73c22dfc30a req-25d4dda5-4388-44ef-85e9-edbe7df1c0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "name": "network-vif-plugged", "status": "completed", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:45.115175 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-f5992cb7-3fef-4e87-9d25-b73c22dfc30a req-25d4dda5-4388-44ef-85e9-edbe7df1c0fc service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:45.115680 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-f5992cb7-3fef-4e87-9d25-b73c22dfc30a req-25d4dda5-4388-44ef-85e9-edbe7df1c0fc service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:45.116104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-f5992cb7-3fef-4e87-9d25-b73c22dfc30a req-25d4dda5-4388-44ef-85e9-edbe7df1c0fc service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:45.127211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-f5992cb7-3fef-4e87-9d25-b73c22dfc30a req-25d4dda5-4388-44ef-85e9-edbe7df1c0fc service nova] Creating event network-vif-plugged:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:12:45.132307 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-f5992cb7-3fef-4e87-9d25-b73c22dfc30a req-25d4dda5-4388-44ef-85e9-edbe7df1c0fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Sep 08 16:12:45.132890 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 317/662] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:45.269702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:45.270303 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:45.277390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:45.277869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:45.278296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:45.278991 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:45.279481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:45.279925 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:45.411119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:45.419896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:45.421320 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:45.422426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-715f81ca-c401-4903-a2a7-3dc3b99792b3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.156868 Sep 08 16:12:45.422991 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 346/663] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:45 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:12:46.452866 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:46.454067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:46.457677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:46.458746 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:46.468008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:46.468487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:46.468921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:46.469606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:46.470058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:46.470475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:46.617208 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:46.625430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:46.626880 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:46.628051 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-54a7e974-782e-4aa5-b3a1-2b277ebd943c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1406 microversion: 2.20 time: 0.182526 Sep 08 16:12:46.628640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 318/664] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:46 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:47.660294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:47.661227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:47.664319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:47.672931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:47.673409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:47.673833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:47.674510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:47.674956 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:47.675371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:47.869350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:47.877958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:47.879385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:12:47.880572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6ca1d33b-b994-42de-80b2-941e71f430cd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1598 microversion: 2.20 time: 0.226847 Sep 08 16:12:47.881333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 347/665] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:12:47 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1598 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:12:47.905311 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:47.905828 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:47.912780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:47.913195 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:47.913637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:47.914708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:47.915169 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:47.915633 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:48.061719 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0d6407a5-fcf7-4a3e-b298-6b7f4be382b0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160353 Sep 08 16:12:48.062764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 319/666] 10.222.0.27 () {60 vars in 1316 bytes} [Thu Sep 8 16:12:47 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:12:49.064790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-1d8b6707-9b20-40a2-a3ae-ec3b44c9c020 req-a3eaddeb-a088-48bc-b259-67dd8ce2bcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:49.075190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1d8b6707-9b20-40a2-a3ae-ec3b44c9c020 req-a3eaddeb-a088-48bc-b259-67dd8ce2bcae service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:49.075736 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1d8b6707-9b20-40a2-a3ae-ec3b44c9c020 req-a3eaddeb-a088-48bc-b259-67dd8ce2bcae service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:49.076333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1d8b6707-9b20-40a2-a3ae-ec3b44c9c020 req-a3eaddeb-a088-48bc-b259-67dd8ce2bcae service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:49.087591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-1d8b6707-9b20-40a2-a3ae-ec3b44c9c020 req-a3eaddeb-a088-48bc-b259-67dd8ce2bcae service nova] Creating event network-changed:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:12:49.092668 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-1d8b6707-9b20-40a2-a3ae-ec3b44c9c020 req-a3eaddeb-a088-48bc-b259-67dd8ce2bcae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032126 Sep 08 16:12:49.093258 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 348/667] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:55.699501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:55.700482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:55.703228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:55.709211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:55.709715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:55.710145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:55.710821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:55.711259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:55.711695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:55.736377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-53e8e1d2-ae4f-4ed5-93cb-5739023fc3c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/ips" status: 200 len: 151 microversion: 2.1 time: 0.044735 Sep 08 16:12:55.736937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 320/668] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:12:55 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:57.092292 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ea7753c-6dc6-4abf-a96e-82effd0cdc71"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:12:57.094740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:57.101084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:57.101554 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:57.101977 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:57.102649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:57.103091 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:57.103501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:57.371408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aa14c3e8-23af-40c1-98d5-7ca7dc57c8e0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283506 Sep 08 16:12:57.372076 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 349/669] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:12:57 2022] POST /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:57.632788 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:57.633348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:57.640461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:57.640942 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:57.641396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:57.642076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:57.642517 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:57.642916 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:57.725092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'services' on Instance uuid b43a6d26-3e4a-4fde-8461-ad70b4e96a46 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:12:57.805193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4e5c5d1e-a254-4c8c-9c66-b0a33b25fc39 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments/eebc1e1a-27eb-4b19-a318-9136cf085364" status: 202 len: 0 microversion: 2.1 time: 0.176185 Sep 08 16:12:57.805953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 321/670] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:12:57 2022] DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments/eebc1e1a-27eb-4b19-a318-9136cf085364 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:12:57.815380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:57.817748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:57.824911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:57.825307 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:57.825752 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:57.826478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:57.826920 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:57.827953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:57.859886 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-96e9344a-02a8-4dc6-af73-806ed24d441b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Sep 08 16:12:57.860879 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 350/671] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:12:57 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:58.878646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:58.881247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:58.888660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:58.889187 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:58.889658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:58.890408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:58.890939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:58.891403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:58.894115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:12:58.926714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d66be6a2-bb17-4f6b-abe8-954ffb91b933 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055872 Sep 08 16:12:58.927271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 322/672] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:12:58 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:12:59.940177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:12:59.942371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:12:59.949405 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:59.949865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:59.950326 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:59.951015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:12:59.951626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:12:59.952051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:12:59.983502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e559862b-966c-4d05-bd89-8a70095015bb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Sep 08 16:12:59.984072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 351/673] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:12:59 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:00.999926 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:01.003433 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:01.014381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:01.015174 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:01.015938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:01.017057 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:01.017801 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:01.018481 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:01.048160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-17a2dae2-76dd-49b2-9762-0abf60f93ed1 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055073 Sep 08 16:13:01.048701 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 323/674] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:00 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:02.067270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:02.070811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:02.081466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:02.082261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:02.082984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:02.084155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:02.084910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:02.085613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:02.089713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:02.121442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4d71ea0f-fdc3-414d-8074-f47c517aab15 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061302 Sep 08 16:13:02.121993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 352/675] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:02 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:03.135225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:03.137418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:03.144175 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:03.144662 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:03.145074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:03.145774 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:03.146221 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:03.146688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:03.177280 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b9f51ddb-1887-43f2-a0ed-fec874533e10 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045855 Sep 08 16:13:03.177728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 324/676] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:03 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:04.191430 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:04.193885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:04.201365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:04.201908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:04.202387 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:04.203155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:04.203682 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:04.204165 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:04.234009 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7a197c85-6f11-4a4f-bb60-6c58287dddf0 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Sep 08 16:13:04.234569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 353/677] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:04 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:04.951891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ea7753c-6dc6-4abf-a96e-82effd0cdc71"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:04.954213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:04.961855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:04.962310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:04.962772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:04.963420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:04.963891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:04.964302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.043393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Invalid volume: volume 5ea7753c-6dc6-4abf-a96e-82effd0cdc71 is already attached to instances: 52645e54-6325-4fb6-a2d5-20a2331a135a Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: POST /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments HTTP/1.1 Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 74 Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:13:05.045251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {"volumeAttachment": {"volumeId": "5ea7753c-6dc6-4abf-a96e-82effd0cdc71"}} Sep 08 16:13:05.046870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Invalid volume: volume 5ea7753c-6dc6-4abf-a96e-82effd0cdc71 is already attached to instances: 52645e54-6325-4fb6-a2d5-20a2331a135a Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'server_id': '52645e54-6325-4fb6-a2d5-20a2331a135a', 'body': {'volumeAttachment': {'volumeId': '5ea7753c-6dc6-4abf-a96e-82effd0cdc71'}}} Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5ea7753c-6dc6-4abf-a96e-82effd0cdc71 is already attached to instances: 52645e54-6325-4fb6-a2d5-20a2331a135a Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:05.047975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5ea7753c-6dc6-4abf-a96e-82effd0cdc71 is already attached to instances: 52645e54-6325-4fb6-a2d5-20a2331a135a Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:05.049377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5ea7753c-6dc6-4abf-a96e-82effd0cdc71 is already attached to instances: 52645e54-6325-4fb6-a2d5-20a2331a135a Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 400 to user: Invalid volume: volume 5ea7753c-6dc6-4abf-a96e-82effd0cdc71 is already attached to instances: 52645e54-6325-4fb6-a2d5-20a2331a135a {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c125f248-899a-41ff-b17f-de838b30fc7c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098845 Sep 08 16:13:05.051274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 325/678] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:13:04 2022] POST /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:13:05.114016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:05.114602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:05.120733 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.121211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.121640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.122455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.122903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.123289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.206090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lazy-loading 'services' on Instance uuid 52645e54-6325-4fb6-a2d5-20a2331a135a {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:05.246739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:05.249651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:05.255856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.256330 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.256776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.257469 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.257917 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.258318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.284330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-132056bf-2f26-4f8b-81d2-eaac072497f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments/5ea7753c-6dc6-4abf-a96e-82effd0cdc71" status: 202 len: 0 microversion: 2.1 time: 0.174186 Sep 08 16:13:05.285160 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 354/679] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:13:05 2022] DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments/5ea7753c-6dc6-4abf-a96e-82effd0cdc71 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:13:05.289563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fc195363-7b7c-4dbb-b444-42589d8cf707 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046983 Sep 08 16:13:05.290171 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 326/680] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:05 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:13:05.294680 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:05.298151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:05.304973 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.305688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.306085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.306972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.307212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.307828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.343483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-48a48e0e-98e2-42bf-ac72-0572e4e1f0df tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053363 Sep 08 16:13:05.344224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 355/681] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:05 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:13:05.370782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:05.371283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:05.377403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.377891 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.378327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.379023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.379503 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.379928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.405950 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:13:05.494826 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-61f9aff8-d3d0-4c55-a88b-e707c53ab04b tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 204 len: 0 microversion: 2.1 time: 0.127738 Sep 08 16:13:05.495533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 327/682] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:13:05 2022] DELETE /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:13:05.503695 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:05.504309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:05.510317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.510795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.511221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.511954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:05.512406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:05.512819 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:05.648405 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:05.656737 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cdfe5f3b-271c-443e-8031-985b9bc5dee8 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1690 microversion: 2.1 time: 0.156932 Sep 08 16:13:05.657310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 356/683] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:05 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:06.414955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:06.417335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:06.424096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:06.424580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:06.425015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:06.425702 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:06.426154 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:06.426583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:06.458978 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d5f7b5ca-9844-4680-9ffb-b583da305577 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105186 Sep 08 16:13:06.459480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 328/684] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:06 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:06.688061 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:06.689119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:06.696229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:06.696710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:06.697133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:06.697806 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:06.698257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:06.698707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:06.832099 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:06.843742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-60701b4a-caa0-4696-be24-bc7ac054c0cb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1690 microversion: 2.1 time: 0.159511 Sep 08 16:13:06.844505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 357/685] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:06 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:07.475564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:07.477664 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:07.484525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:07.485015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:07.485449 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:07.486148 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:07.486605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:07.487037 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:07.516820 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3f7c496d-74b7-468b-8751-f48cda4cc75a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047437 Sep 08 16:13:07.517373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 329/686] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:07 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:07.936558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:07.937133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:07.943786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:07.944259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:07.944687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:07.945385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:07.945858 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:07.946274 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:08.074291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:08.082074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4cbb2f51-a7cb-43fa-8b7d-f6a53ebaffd3 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1690 microversion: 2.1 time: 0.216999 Sep 08 16:13:08.082646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 358/687] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:07 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:08.536012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:08.538864 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:08.546897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:08.547472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:08.547960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:08.548726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:08.549234 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:08.549708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:08.580299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cad7fb96-b83e-47ef-8f29-65dbbaa01468 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051083 Sep 08 16:13:08.580868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 330/688] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:08 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:09.110454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:09.111495 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:09.122879 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:09.123733 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:09.124455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:09.125590 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:09.126345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:09.127051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:09.257083 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:09.264923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dc869d1e-8b58-4451-83c3-f1c5bd385927 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1690 microversion: 2.1 time: 0.161261 Sep 08 16:13:09.265493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 359/689] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:09 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:09.593620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:09.595848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:09.602323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:09.602884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:09.603337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:09.604060 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:09.604511 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:09.604912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:09.637408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-04023dce-0a43-44c1-b484-b1dc6bbcf098 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047965 Sep 08 16:13:09.638007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 331/690] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:09 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:10.288407 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:10.289122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:10.296093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.296585 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.297014 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.297771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.298206 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.298624 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.431591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:10.439813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a39709af-a1fb-4e81-b0b2-b24581850321 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1690 microversion: 2.1 time: 0.155286 Sep 08 16:13:10.440370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 360/691] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:10 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:10.650565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:10.652893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:10.659758 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.660275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.660712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.661538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.662057 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.662528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.693596 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2eda54d0-585a-4d36-b85b-50c457e5ee3c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047151 Sep 08 16:13:10.694182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 332/692] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:10 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:13:10.757055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:10.757555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:10.763610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.764087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.764514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.765203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.765900 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.766064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.791886 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:13:10.885100 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-c1a7de13-873c-49a0-a793-c488728547c3 req-c7656391-9b9f-4a00-ae08-9a9874af05c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43a6d26-3e4a-4fde-8461-ad70b4e96a46", "name": "network-vif-deleted", "tag": "a2422c6e-ed88-4508-ab49-226147c59fb9"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:10.891346 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b1564d3d-c344-4cbb-a692-dcf6490199e9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 204 len: 0 microversion: 2.1 time: 0.137434 Sep 08 16:13:10.895080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 361/693] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:13:10 2022] DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:13:10.895348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c1a7de13-873c-49a0-a793-c488728547c3 req-c7656391-9b9f-4a00-ae08-9a9874af05c5 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.895871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c1a7de13-873c-49a0-a793-c488728547c3 req-c7656391-9b9f-4a00-ae08-9a9874af05c5 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.896338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-c1a7de13-873c-49a0-a793-c488728547c3 req-c7656391-9b9f-4a00-ae08-9a9874af05c5 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.902928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:10.903895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:10.910373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.911070 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.911626 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.912490 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:10.912944 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:10.913366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:10.919344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-c1a7de13-873c-49a0-a793-c488728547c3 req-c7656391-9b9f-4a00-ae08-9a9874af05c5 service nova] Creating event network-vif-deleted:a2422c6e-ed88-4508-ab49-226147c59fb9 for instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 on hv-cinder-85625 Sep 08 16:13:10.929356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-c1a7de13-873c-49a0-a793-c488728547c3 req-c7656391-9b9f-4a00-ae08-9a9874af05c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048265 Sep 08 16:13:10.931216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 333/694] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:11.078873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:11.088724 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1b7651f3-805e-41c9-b4dd-28ef9065d7b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1684 microversion: 2.1 time: 0.190588 Sep 08 16:13:11.089319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 362/695] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:10 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1684 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:11.464317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:11.468008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:11.475164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:11.475719 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:11.476136 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:11.476844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:11.477304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:11.477727 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:11.546650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:11.555208 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7bebbb5c-bdb6-442d-9c38-c80ceea9c92f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1331 microversion: 2.1 time: 0.095046 Sep 08 16:13:11.555828 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 334/696] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:11 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:12.112651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:12.113236 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:12.124241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:12.125355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:12.126159 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:12.127682 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:12.128580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:12.129456 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:12.268858 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:12.277075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-253e3e3a-7253-4d25-ba9e-60ef350b05a2 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1684 microversion: 2.1 time: 0.168477 Sep 08 16:13:12.277649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 363/697] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:12 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:12.578649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:12.579258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:12.586332 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:12.586817 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:12.587255 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:12.587987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:12.588449 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:12.588882 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:12.625115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:12.625613 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:12.626042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:12.626472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'fault' on Instance uuid b43a6d26-3e4a-4fde-8461-ad70b4e96a46 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:12.671134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:12.679337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2e38d012-9c9b-473a-9cf5-aefae34ea5eb tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 200 len: 1336 microversion: 2.1 time: 0.104622 Sep 08 16:13:12.680343 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 335/698] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:12 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:13.300741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:13.301375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:13.308085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:13.308559 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:13.308984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:13.309727 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:13.310463 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:13.310590 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:13.374913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:13.382737 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ef0d0a43-00cb-4c63-8f0a-c5697810dd4a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 200 len: 1616 microversion: 2.1 time: 0.086024 Sep 08 16:13:13.383342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 364/699] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:13 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 1616 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:13.547523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-ca288349-cce9-470c-ab11-c02fb44380cc req-019d86a6-3a29-4afe-bc3f-ab0d9dd7676a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52645e54-6325-4fb6-a2d5-20a2331a135a", "name": "network-vif-deleted", "tag": "fec67c39-eccc-4e78-970a-671ae7551ae2"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:13.559429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca288349-cce9-470c-ab11-c02fb44380cc req-019d86a6-3a29-4afe-bc3f-ab0d9dd7676a service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:13.560595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca288349-cce9-470c-ab11-c02fb44380cc req-019d86a6-3a29-4afe-bc3f-ab0d9dd7676a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:13.561279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ca288349-cce9-470c-ab11-c02fb44380cc req-019d86a6-3a29-4afe-bc3f-ab0d9dd7676a service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:13.575567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-ca288349-cce9-470c-ab11-c02fb44380cc req-019d86a6-3a29-4afe-bc3f-ab0d9dd7676a service nova] Creating event network-vif-deleted:fec67c39-eccc-4e78-970a-671ae7551ae2 for instance 52645e54-6325-4fb6-a2d5-20a2331a135a on hv-cinder-85625 Sep 08 16:13:13.580515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-ca288349-cce9-470c-ab11-c02fb44380cc req-019d86a6-3a29-4afe-bc3f-ab0d9dd7676a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046482 Sep 08 16:13:13.584328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 336/700] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:13.705051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:13.705664 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: b43a6d26-3e4a-4fde-8461-ad70b4e96a46] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:13.712493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:13.712969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:13.713397 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:13.714085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:13.714537 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:13.714955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:13.737032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] HTTP exception thrown: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 could not be found. Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Request method failure captured: Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 HTTP/1.1 Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNoFW1fgwP5T-ivL1vEtVb4Xaznb9dG5A0WWMjHfg8Fpra-s-xxYZh7-tMiHLTO_DjEJytNHYcDiylJiWewzjGu0mAG8LXLmfm15CD6Qhbg2P7SRIHOUDznqLmi_eUI0BZh1Q5KELX0YJjKFlF3bLDOKR_PftJIwT9izYmT6Bg7bHA Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:13:13.738454 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73c9cf0f579144eb80c090456d363a05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}] Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 18375266a64348df879a9eec53bfcbf9 Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 could not be found. Sep 08 16:13:13.740169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'b43a6d26-3e4a-4fde-8461-ad70b4e96a46'} Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 could not be found. Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:13.740978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 could not be found. Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 could not be found. Sep 08 16:13:13.742291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:13.743390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Returning 404 to user: Instance b43a6d26-3e4a-4fde-8461-ad70b4e96a46 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:13.743390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6e6be57c-f127-447d-ad9d-f62383928c98 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46" status: 404 len: 111 microversion: 2.1 time: 0.039281 Sep 08 16:13:13.743390 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 365/701] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:13 2022] GET /compute/v2.1/servers/b43a6d26-3e4a-4fde-8461-ad70b4e96a46 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:13:13.750065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-45e1d6d6-98e8-4d9b-a64a-16c7cce56327 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '.version_select at 0x7f88600d70d0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:13.774693 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-45e1d6d6-98e8-4d9b-a64a-16c7cce56327 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1104383644" status: 202 len: 0 microversion: 2.1 time: 0.028380 Sep 08 16:13:13.777448 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 337/702] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 16:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1104383644 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:13:14.410065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:14.411382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:14.416519 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:14.420482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:14.420969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:14.421396 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:14.422087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:14.427876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:14.428412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:14.446542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a HTTP/1.1 Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:13:14.448134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:13:14.449734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '52645e54-6325-4fb6-a2d5-20a2331a135a'} Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:14.450813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:13:14.452252 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:14.453556 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:14.453556 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9d5df2dc-59cb-47eb-b209-241c73ebe53b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 404 len: 111 microversion: 2.1 time: 0.046977 Sep 08 16:13:14.459177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c78a7533-7fd5-4d03-a258-4713d2434b1e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '.version_select at 0x7f886003caf0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:14.461499 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 366/703] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:14 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:13:14.481923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c78a7533-7fd5-4d03-a258-4713d2434b1e tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568815663" status: 202 len: 0 microversion: 2.1 time: 0.026735 Sep 08 16:13:14.485962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 338/704] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 16:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568815663 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:13:15.350425 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5035b4df-75c3-4760-9a05-976bf1788fa5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: .version_select at 0x7f88605003a0>, body: {"keypair": {"name": "tempest-keypair-137853086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClXh20YUwPYibAGIoBbdGxputWBTdjOCGNh0bOFX3EdeW08/4bKWIQPEnjINAjwXtXdODnm77ntqW4jU0USz5HXV5/QnqII7ysXn3wQtszn1aHXMMORpgzzNzCD+8cFVw=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:15.366772 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-5035b4df-75c3-4760-9a05-976bf1788fa5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:13:15.370926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-5035b4df-75c3-4760-9a05-976bf1788fa5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:13:15.394824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5035b4df-75c3-4760-9a05-976bf1788fa5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048512 Sep 08 16:13:15.395395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 367/705] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:13:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:16.779621 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:16.780242 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:16.786523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:16.787049 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:16.787498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:16.788196 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:16.788651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:16.789075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:16.815553 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:13:16.832920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:16.907686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3127dcb5-a9cd-4e1b-a63b-c16a38020446 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 204 len: 0 microversion: 2.1 time: 0.131692 Sep 08 16:13:16.912849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 339/706] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:13:16 2022] DELETE /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:13:16.920480 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:16.921170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:16.923760 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1208922531", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a88764e-b620-4723-a684-b37f114bda88"}], "security_groups": [{"name": "tempest-securitygroup--1151099193"}], "key_name": "tempest-keypair-137853086", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:16.925004 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:13:16.925215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Thu Sep 8 16:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c (ip 10.222.0.27) !!! Sep 08 16:13:16.931927 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:16.932486 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:16.933029 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:16.933895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:16.934373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:16.934874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:17.029594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] validate_networks() for [('2a88764e-b620-4723-a684-b37f114bda88', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:13:17.064972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:17.067467 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:17.074262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e7499122-d8b5-4372-be14-d084609df368 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1506 microversion: 2.1 time: 0.159280 Sep 08 16:13:17.075086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 368/707] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:16 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:17.476191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:13:17.476646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:13:17.477124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:13:17.477532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:13:17.477946 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:13:17.487209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:17.487728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:17.488168 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:17.488884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:17.489338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:17.489768 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:17.507362 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:13:17.512109 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Getting quotas for user 00b673d5c65d40d9a90cc3b579e83e7f and project 91730a2601824af19a540c48681e6fc3. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:13:17.524815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:13:17.527213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:13:17.578278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-40c70457-de47-4390-a2de-2cffc365fd5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659233 Sep 08 16:13:17.578931 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 340/708] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:13:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:13:17.590890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d8705d0b-968c-41c1-9658-1c4531c7379c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:17.591536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d8705d0b-968c-41c1-9658-1c4531c7379c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:17.647582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d8705d0b-968c-41c1-9658-1c4531c7379c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:17.654700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d8705d0b-968c-41c1-9658-1c4531c7379c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1241 microversion: 2.1 time: 0.068114 Sep 08 16:13:17.655294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 369/709] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:17 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:18.097548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:18.098165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:18.105534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:18.106020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:18.106452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:18.107129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:18.107634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:18.108052 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:18.238545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:18.246587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-907fda87-1980-41da-8ae9-f2cbc35358d2 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1506 microversion: 2.1 time: 0.153496 Sep 08 16:13:18.247163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 341/710] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:18 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:18.681877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:18.682951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:18.694349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:18.694828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:18.695262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:18.695987 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:18.696443 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:18.696870 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:18.760543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:18.768294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f3dc555f-a8a5-48b4-bf8d-1b979c79f4f3 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1245 microversion: 2.1 time: 0.093057 Sep 08 16:13:18.768863 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 370/711] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:18 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:19.271805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:19.272567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:19.279598 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:19.280176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:19.280703 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:19.282274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:19.282814 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:19.283372 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:19.497212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:19.506089 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cdca99f8-67ae-4576-94c0-798601f13542 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1506 microversion: 2.1 time: 0.238288 Sep 08 16:13:19.506741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 342/712] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:19 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:19.725474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-4bc386ee-e885-4363-ac6d-c746f6680866 req-558bd9ab-0ec5-4b71-bd0b-592acddb2485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387edd6e-7535-44c5-b75d-4a17415dd41c", "name": "network-vif-deleted", "tag": "16a74b42-c0f4-435a-b6b7-c1c2856418c8"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:19.736378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4bc386ee-e885-4363-ac6d-c746f6680866 req-558bd9ab-0ec5-4b71-bd0b-592acddb2485 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:19.737225 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4bc386ee-e885-4363-ac6d-c746f6680866 req-558bd9ab-0ec5-4b71-bd0b-592acddb2485 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:19.737875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4bc386ee-e885-4363-ac6d-c746f6680866 req-558bd9ab-0ec5-4b71-bd0b-592acddb2485 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:19.752609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-4bc386ee-e885-4363-ac6d-c746f6680866 req-558bd9ab-0ec5-4b71-bd0b-592acddb2485 service nova] Creating event network-vif-deleted:16a74b42-c0f4-435a-b6b7-c1c2856418c8 for instance 387edd6e-7535-44c5-b75d-4a17415dd41c on hv-cinder-85625 Sep 08 16:13:19.760874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-4bc386ee-e885-4363-ac6d-c746f6680866 req-558bd9ab-0ec5-4b71-bd0b-592acddb2485 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Sep 08 16:13:19.762143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 371/713] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:19.797025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:19.798062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:19.804379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:19.805157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:19.805809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:19.806856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:19.807661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:19.808299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:19.897741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:19.905881 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-444e36af-34d8-4720-b82c-98c10612fe83 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1311 microversion: 2.1 time: 0.112695 Sep 08 16:13:19.908659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 343/714] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:19 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:20.351165 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:20.353474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:20.359671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.360168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.360602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.361294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.361732 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.362168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.391800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-88a32cfe-1df7-4559-8f94-909a22772357 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045018 Sep 08 16:13:20.392386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 372/715] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:13:20 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:13:20.534782 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:20.536316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:20.571892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.572808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.573743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.574747 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.575415 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.576173 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.636742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:20.637102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:20.641403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.642041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.642532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.643059 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'fault' on Instance uuid 387edd6e-7535-44c5-b75d-4a17415dd41c {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:20.647972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.648450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.648888 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.649602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.650051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.650474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.680856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:13:20.696752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:20.706636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-16e09b3e-801b-401d-84e1-19c340e270e5 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 200 len: 1312 microversion: 2.1 time: 0.181079 Sep 08 16:13:20.707236 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 344/716] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:20 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:20.780428 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6306f77c-6223-4351-842f-90e12c1f90e8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 204 len: 0 microversion: 2.1 time: 0.147471 Sep 08 16:13:20.781323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 373/717] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:13:20 2022] DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 16:13:20.790198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:20.791035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:20.798002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.798913 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.799624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.800438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.801071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.801498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.930559 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:20.931322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:20.938110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.939030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.939598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:20.940357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:20.941063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:20.941561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.041090 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:21.049303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b2021748-fb89-497e-b11e-a0777d119a69 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1674 microversion: 2.1 time: 0.263671 Sep 08 16:13:21.063508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 345/718] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:20 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1674 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:21.075661 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:21.083686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1f073d61-553e-43a3-a94d-cfdb056766ab tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.157408 Sep 08 16:13:21.084265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 374/719] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:20 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:21.734417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:21.735527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: 387edd6e-7535-44c5-b75d-4a17415dd41c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:21.746424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.747287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.748120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.749272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.750077 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.750793 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.766974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] HTTP exception thrown: Instance 387edd6e-7535-44c5-b75d-4a17415dd41c could not be found. Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Request method failure captured: Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c HTTP/1.1 Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNoFW1fgwP5T-ivL1vEtVb4Xaznb9dG5A0WWMjHfg8Fpra-s-xxYZh7-tMiHLTO_DjEJytNHYcDiylJiWewzjGu0mAG8LXLmfm15CD6Qhbg2P7SRIHOUDznqLmi_eUI0BZh1Q5KELX0YJjKFlF3bLDOKR_PftJIwT9izYmT6Bg7bHA Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:13:21.768713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73c9cf0f579144eb80c090456d363a05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}] Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 18375266a64348df879a9eec53bfcbf9 Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 387edd6e-7535-44c5-b75d-4a17415dd41c could not be found. Sep 08 16:13:21.770288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '387edd6e-7535-44c5-b75d-4a17415dd41c'} Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387edd6e-7535-44c5-b75d-4a17415dd41c could not be found. Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:21.771239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387edd6e-7535-44c5-b75d-4a17415dd41c could not be found. Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387edd6e-7535-44c5-b75d-4a17415dd41c could not be found. Sep 08 16:13:21.773069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:21.774324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Returning 404 to user: Instance 387edd6e-7535-44c5-b75d-4a17415dd41c could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:21.774324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-42a957a7-bb5c-4256-a6f1-6d46ca899964 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c" status: 404 len: 111 microversion: 2.1 time: 0.042435 Sep 08 16:13:21.774324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 346/720] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:21 2022] GET /compute/v2.1/servers/387edd6e-7535-44c5-b75d-4a17415dd41c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:13:21.778207 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-0a779cec-5816-4e2e-9398-7025058e1e55 req-f68c0ed1-8043-4110-9ee0-d20c835017d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7a000b-14e1-44c6-a9c7-6b485a91c350", "tag": "ea042f6a-f127-410f-8d28-d13b783df768"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:21.778855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:21.779347 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:21.785680 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.786164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.786580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.787312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.787807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.788229 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.788346 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-0a779cec-5816-4e2e-9398-7025058e1e55 req-f68c0ed1-8043-4110-9ee0-d20c835017d7 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.788970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-0a779cec-5816-4e2e-9398-7025058e1e55 req-f68c0ed1-8043-4110-9ee0-d20c835017d7 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.789451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-0a779cec-5816-4e2e-9398-7025058e1e55 req-f68c0ed1-8043-4110-9ee0-d20c835017d7 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.800535 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-0a779cec-5816-4e2e-9398-7025058e1e55 req-f68c0ed1-8043-4110-9ee0-d20c835017d7 service nova] Creating event network-changed:ea042f6a-f127-410f-8d28-d13b783df768 for instance af7a000b-14e1-44c6-a9c7-6b485a91c350 on hv-cinder-85625 Sep 08 16:13:21.805455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-0a779cec-5816-4e2e-9398-7025058e1e55 req-f68c0ed1-8043-4110-9ee0-d20c835017d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031424 Sep 08 16:13:21.806098 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 375/721] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:13:21.814639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:13:21.895755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7bf671fa-15ba-4ae5-babd-0a8086bdce9f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 204 len: 0 microversion: 2.1 time: 0.120138 Sep 08 16:13:21.896320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 347/722] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:13:21 2022] DELETE /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:13:21.905037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:21.905732 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:21.911953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.912582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.913032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:21.913721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:21.914495 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:21.915044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:22.049409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:22.057690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-78f4d0c8-2b48-45b0-bf64-b6198b410269 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.156819 Sep 08 16:13:22.058273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 376/723] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:21 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:22.074172 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:22.074876 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:22.081262 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:22.081748 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:22.082185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:22.082872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:22.083329 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:22.083850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:22.106171 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:22.106778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:22.113331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:22.113821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:22.114382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:22.115108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:22.115561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:22.115983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:22.218799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:22.226858 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8534398e-77ea-4c0a-b668-76600d090430 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1674 microversion: 2.1 time: 0.156954 Sep 08 16:13:22.227437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 348/724] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:22 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:22.246334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:22.254053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ed255aee-f837-4e07-b6e7-d90c4819f5b9 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.151774 Sep 08 16:13:22.254642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 377/725] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:22 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:23.085289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:23.086072 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:23.088560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:23.094108 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:23.094592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:23.095028 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:23.095753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:23.096204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:23.096625 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:23.232193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:23.240108 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-489e88e8-a148-4b20-9fb5-44380f07248a tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.161324 Sep 08 16:13:23.240687 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 349/726] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:23 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:23.250377 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:23.251106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:23.258302 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:23.258781 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:23.259205 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:23.259923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:23.260370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:23.260781 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:23.276677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:23.277323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:23.283184 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:23.283709 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:23.284143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:23.284824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:23.285275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:23.285694 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:23.394649 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:23.403760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2ad3fb04-e3a6-40d3-b523-815b8c0a6d4a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1674 microversion: 2.1 time: 0.157217 Sep 08 16:13:23.404528 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 378/727] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:23 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:23.422988 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:23.430625 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c4758c27-45e8-4f0b-83ff-7453991a2e70 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.157885 Sep 08 16:13:23.431185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 350/728] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:23 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:24.266305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:24.267347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:24.276378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:24.276851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:24.277279 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:24.277991 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:24.278451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:24.278873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:24.423224 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:24.426749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:24.427348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:24.431474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c4c335be-891a-4391-abab-bb8e04485bbd tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.171748 Sep 08 16:13:24.432122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 379/729] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:24 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:24.433911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:24.434387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:24.434817 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:24.435513 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:24.435960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:24.436376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:24.453474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:24.454001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:24.460498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:24.461112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:24.461543 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:24.462232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:24.462678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:24.463088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:24.564710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:24.572579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f3890aa9-c7a2-44f7-8eec-4f2b9a364b26 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1674 microversion: 2.1 time: 0.149690 Sep 08 16:13:24.573384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 351/730] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:24 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:24.592549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:24.600514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-625b6a33-66e8-4b29-88e8-9a0a0936757a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.150824 Sep 08 16:13:24.601137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 380/731] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:24 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:25.459527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:25.460781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:25.471222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:25.472081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:25.472796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:25.473959 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:25.474704 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:25.475400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:25.596642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:25.597241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:25.603832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:25.603981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:25.604298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:25.604724 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:25.605408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:25.605855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:25.606267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:25.611686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e22a7882-17c8-4708-b996-56c27a9baf3f tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.158865 Sep 08 16:13:25.612273 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 352/732] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:25 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:25.622177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:25.623131 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:25.629948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:25.630507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:25.631009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:25.631775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:25.632277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:25.632706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:25.738983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:25.747158 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-43025227-16dc-4669-a2b3-8d737c4208f3 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1674 microversion: 2.1 time: 0.154647 Sep 08 16:13:25.747823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 381/733] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:25 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:25.763880 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:25.771939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-003172ea-7224-45b4-9cf0-cf322aca1952 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.153512 Sep 08 16:13:25.772508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 353/734] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:25 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:26.635846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:26.636446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:26.643117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:26.643642 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:26.644069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:26.644751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:26.645197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:26.645609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:26.770537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:26.771111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:26.777700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:26.778167 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:26.778808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:26.779505 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:26.780134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:26.780555 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:26.790501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:26.798866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-88cc573b-26ad-4934-a0e4-8d68eccb6962 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1519 microversion: 2.1 time: 0.167048 Sep 08 16:13:26.807693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 382/735] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:26 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:26.807917 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:26.812522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:26.813517 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:26.820726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:26.821208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:26.821635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:26.822327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:26.822773 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:26.823194 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:26.958898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:26.967326 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ebce2f37-da63-4d0a-9558-74c4ac42c687 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.166381 Sep 08 16:13:26.967931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 383/736] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:26 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:27.428993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:27.437937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e5505b31-48ba-4c28-a8ff-68280514c136 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1674 microversion: 2.1 time: 0.671507 Sep 08 16:13:27.438971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 354/737] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:26 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1674 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:27.625151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-7586b914-bde6-4aa0-82b7-05ec865adaa4 req-1b5400cc-7385-4185-9027-722def59f1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcc5ea9-0755-493f-9c67-4a0d0076df04", "name": "network-vif-deleted", "tag": "069de4c6-aa5c-4db6-aed3-8e98f197a113"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:27.636072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-7586b914-bde6-4aa0-82b7-05ec865adaa4 req-1b5400cc-7385-4185-9027-722def59f1bf service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:27.636771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-7586b914-bde6-4aa0-82b7-05ec865adaa4 req-1b5400cc-7385-4185-9027-722def59f1bf service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:27.637059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-7586b914-bde6-4aa0-82b7-05ec865adaa4 req-1b5400cc-7385-4185-9027-722def59f1bf service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:27.648934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-7586b914-bde6-4aa0-82b7-05ec865adaa4 req-1b5400cc-7385-4185-9027-722def59f1bf service nova] Creating event network-vif-deleted:069de4c6-aa5c-4db6-aed3-8e98f197a113 for instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 on hv-cinder-85625 Sep 08 16:13:27.652693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:27.654889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-7586b914-bde6-4aa0-82b7-05ec865adaa4 req-1b5400cc-7385-4185-9027-722def59f1bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Sep 08 16:13:27.656201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 384/738] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:27.822840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:27.823476 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:27.825580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:27.826538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:27.833170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:27.833661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:27.834140 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:27.834835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:27.835282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:27.835728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:27.871102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:27.872294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:27.872730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:27.873403 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'fault' on Instance uuid fbcc5ea9-0755-493f-9c67-4a0d0076df04 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:27.939156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:27.947930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-48cc3a58-df26-4f45-89f8-860bd6aa5d64 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1311 microversion: 2.1 time: 0.129368 Sep 08 16:13:27.948525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 355/739] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:27 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:27.993750 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:27.995859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:28.009549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:28.010037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:28.010461 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:28.011357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:28.011834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:28.012247 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:28.158884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:28.167648 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-588b9535-5797-42d6-a92b-a322bf55cccf tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.180499 Sep 08 16:13:28.168242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 385/740] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:27 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:28.462612 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:28.463393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:28.469822 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:28.470309 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:28.470738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:28.471430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:28.471983 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:28.472401 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:28.539042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:28.547994 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b20ccfb5-a9db-4752-babb-f821e291b451 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 200 len: 1606 microversion: 2.1 time: 0.089435 Sep 08 16:13:28.548856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 356/741] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:28 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 1606 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:28.973980 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:28.975136 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:28.982912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:28.983684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:28.984119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:28.984832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:28.985280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:28.985890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.022456 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:29.023215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:29.023749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.024363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lazy-loading 'fault' on Instance uuid fbcc5ea9-0755-493f-9c67-4a0d0076df04 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:29.027412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:29.079638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18375266a64348df879a9eec53bfcbf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c9cf0f579144eb80c090456d363a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:29.087994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-38edece3-d088-44c6-a5d8-02a710f80b46 tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 200 len: 1311 microversion: 2.1 time: 0.120426 Sep 08 16:13:29.088918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 386/742] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:28 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:29.190733 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:29.191345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:29.197960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:29.198455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:29.198882 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.199627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:29.200074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:29.200482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.331673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:29.339897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f055fa3b-80ad-49ae-8bc6-79700b072913 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.153509 Sep 08 16:13:29.340509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 357/743] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:29 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:29.571828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:29.572460 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:29.578745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:29.579289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:29.579682 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.580363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:29.580810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:29.581229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.596354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] HTTP exception thrown: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Request method failure captured: Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b HTTP/1.1 Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhOyZ0uvcTkL6ym7fkOSTVvc-dBpniz-LDYuFMD9mcSfxOXd6gW8GDkWed1qjsiD_ry9voB6tJwFiqnLB83jduTgcbD9T_q2lQn4qKdFVOQo9xBt8zTNicgO1hftGCQbR5vIX5-J4wfK-2QuXmY1HoOwS8wdFIcVSOPABqhc7-2Cksc Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:13:29.597996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67853e0ad324ac595650e59f9a90f56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}] Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 965cbbdb06c248698ef54527c29767df Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:13:29.599613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '3328192d-87f0-46fe-97e1-57559cb1318b'} Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:29.601442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:13:29.602864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:13:29.604151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Returning 404 to user: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:29.604151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-df1b6479-532e-4a2f-a08f-3ade1fda9d25 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 404 len: 111 microversion: 2.1 time: 0.031561 Sep 08 16:13:29.604151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 387/744] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:29 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:13:29.608601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0cca32a1-5d64-4b87-80b1-9d906edb72ff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '.version_select at 0x7f8863a753a0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:29.630068 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0cca32a1-5d64-4b87-80b1-9d906edb72ff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134768320" status: 202 len: 0 microversion: 2.1 time: 0.025419 Sep 08 16:13:29.630732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 358/745] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 16:13:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134768320 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:13:29.733655 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-61b90e14-92d3-43a8-b228-87fd1daa00d8 req-1f96d1e0-ecd7-4cc5-8dd4-77f2c95bd839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3328192d-87f0-46fe-97e1-57559cb1318b", "name": "network-vif-deleted", "tag": "060e2941-482e-4264-ae48-05f43e053bb4"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:29.743219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-61b90e14-92d3-43a8-b228-87fd1daa00d8 req-1f96d1e0-ecd7-4cc5-8dd4-77f2c95bd839 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:29.743729 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-61b90e14-92d3-43a8-b228-87fd1daa00d8 req-1f96d1e0-ecd7-4cc5-8dd4-77f2c95bd839 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:29.744149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-61b90e14-92d3-43a8-b228-87fd1daa00d8 req-1f96d1e0-ecd7-4cc5-8dd4-77f2c95bd839 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:29.755432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-61b90e14-92d3-43a8-b228-87fd1daa00d8 req-1f96d1e0-ecd7-4cc5-8dd4-77f2c95bd839 service nova] Creating event network-vif-deleted:060e2941-482e-4264-ae48-05f43e053bb4 for instance 3328192d-87f0-46fe-97e1-57559cb1318b on hv-cinder-85625 Sep 08 16:13:29.760818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-61b90e14-92d3-43a8-b228-87fd1daa00d8 req-1f96d1e0-ecd7-4cc5-8dd4-77f2c95bd839 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086518 Sep 08 16:13:29.761592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 388/746] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:30.111953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:30.112628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] [instance: fbcc5ea9-0755-493f-9c67-4a0d0076df04] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:30.118777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:30.119269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:30.119753 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:30.120485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:30.120980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:30.121406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:30.137652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] HTTP exception thrown: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 could not be found. Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Request method failure captured: Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 HTTP/1.1 Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNoFW1fgwP5T-ivL1vEtVb4Xaznb9dG5A0WWMjHfg8Fpra-s-xxYZh7-tMiHLTO_DjEJytNHYcDiylJiWewzjGu0mAG8LXLmfm15CD6Qhbg2P7SRIHOUDznqLmi_eUI0BZh1Q5KELX0YJjKFlF3bLDOKR_PftJIwT9izYmT6Bg7bHA Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:13:30.139396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_73c9cf0f579144eb80c090456d363a05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/73c9cf0f579144eb80c090456d363a05"}]}] Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 73c9cf0f579144eb80c090456d363a05 Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-713384690 Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 18375266a64348df879a9eec53bfcbf9 Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-ServerRescueNegativeTestJSON-713384690-project Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 could not be found. Sep 08 16:13:30.141087 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'fbcc5ea9-0755-493f-9c67-4a0d0076df04'} Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 could not be found. Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:30.142223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 could not be found. Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 could not be found. Sep 08 16:13:30.143572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:30.144679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] Returning 404 to user: Instance fbcc5ea9-0755-493f-9c67-4a0d0076df04 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:30.144679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-038292e8-1a76-4a7f-aeca-747c149178ed tempest-ServerRescueNegativeTestJSON-713384690 tempest-ServerRescueNegativeTestJSON-713384690-project] 10.222.0.27 "GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04" status: 404 len: 111 microversion: 2.1 time: 0.033314 Sep 08 16:13:30.144679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 359/747] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:30 2022] GET /compute/v2.1/servers/fbcc5ea9-0755-493f-9c67-4a0d0076df04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:13:30.244600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-26d9be75-c2ff-433e-94c5-81529ad27e21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: .version_select at 0x7f88601be940>, body: {"keypair": {"name": "tempest-keypair-1245423295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9XzmYqU0HElHMLS9fzNaeH9cWCa2eGCkXRPe2kC7boon9cvsyLjCYrc7iYsmGWNN794AZf4d/bYrpSIwWl5O25KV1EoK3aKsX4NZzvUznZPOlP4j1mnK4Cg6fXE43f4g=="}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:30.259994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-26d9be75-c2ff-433e-94c5-81529ad27e21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for project c67853e0ad324ac595650e59f9a90f56. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:13:30.264135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.quota [None req-26d9be75-c2ff-433e-94c5-81529ad27e21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for user 965cbbdb06c248698ef54527c29767df and project c67853e0ad324ac595650e59f9a90f56. Resources: {'key_pairs'} {{(pid=120783) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:13:30.286981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-26d9be75-c2ff-433e-94c5-81529ad27e21 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047710 Sep 08 16:13:30.287602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 389/748] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:13:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:30.367609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:30.368222 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:30.375157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:30.375792 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:30.376303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:30.377060 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:30.377589 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:30.378081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:30.534165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:30.542447 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5f964062-16f3-4d81-9639-b9f588435b25 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.178946 Sep 08 16:13:30.543166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 360/749] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:30 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:31.565794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:31.566616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:31.574447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:31.575685 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:31.576201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:31.576975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:31.577628 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:31.578063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:31.861873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1193927222", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9938b0f8-8ae3-4efd-981a-26cf6a9b4e30"}], "security_groups": [{"name": "tempest-securitygroup--1227230894"}], "key_name": "tempest-keypair-1245423295", "user_data": "}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:31.974435 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] validate_networks() for [('9938b0f8-8ae3-4efd-981a-26cf6a9b4e30', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:13:32.027294 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:32.036123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6df7bd41-4423-43cf-b47a-353ff49fd94a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.475129 Sep 08 16:13:32.047587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 390/750] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:31 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:32.372237 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:13:32.372763 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:13:32.373308 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:13:32.374205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:13:32.374340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:13:32.384227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:32.384861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:32.385437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:32.386396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:32.386987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:32.387419 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:32.405043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for project c67853e0ad324ac595650e59f9a90f56. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:13:32.409786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Getting quotas for user 965cbbdb06c248698ef54527c29767df and project c67853e0ad324ac595650e59f9a90f56. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:13:32.421424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:13:32.423807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:13:32.480043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8ea24388-5b5c-4b92-9aaa-076fd7223bff tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622519 Sep 08 16:13:32.487041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 361/751] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:13:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 16:13:32.491888 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8a982c01-72e0-446f-b136-6fd1d917bb33 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:32.492802 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8a982c01-72e0-446f-b136-6fd1d917bb33 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:32.586774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8a982c01-72e0-446f-b136-6fd1d917bb33 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:32.595711 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8a982c01-72e0-446f-b136-6fd1d917bb33 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1238 microversion: 2.1 time: 0.107520 Sep 08 16:13:32.597559 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 391/752] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:32 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:33.060239 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:33.060888 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:33.067305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.068014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.068437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.069299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.069752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.070171 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.282311 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:33.292001 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2af803a2-cb92-4d11-88ca-76d4fc760715 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.236193 Sep 08 16:13:33.292882 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 362/753] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:33 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:33.435352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-1fb0b2b2-e1d6-47f3-b98f-69b9d7c97908 req-a8329e2e-d020-46f7-bee4-ea75ec691709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a000b-14e1-44c6-a9c7-6b485a91c350", "name": "network-vif-plugged", "status": "completed", "tag": "ea042f6a-f127-410f-8d28-d13b783df768"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:33.446491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1fb0b2b2-e1d6-47f3-b98f-69b9d7c97908 req-a8329e2e-d020-46f7-bee4-ea75ec691709 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.448872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1fb0b2b2-e1d6-47f3-b98f-69b9d7c97908 req-a8329e2e-d020-46f7-bee4-ea75ec691709 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.448872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1fb0b2b2-e1d6-47f3-b98f-69b9d7c97908 req-a8329e2e-d020-46f7-bee4-ea75ec691709 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.459483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-1fb0b2b2-e1d6-47f3-b98f-69b9d7c97908 req-a8329e2e-d020-46f7-bee4-ea75ec691709 service nova] Creating event network-vif-plugged:ea042f6a-f127-410f-8d28-d13b783df768 for instance af7a000b-14e1-44c6-a9c7-6b485a91c350 on hv-cinder-85625 Sep 08 16:13:33.477391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-1fb0b2b2-e1d6-47f3-b98f-69b9d7c97908 req-a8329e2e-d020-46f7-bee4-ea75ec691709 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040298 Sep 08 16:13:33.478833 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 392/754] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:33.546738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:33.547297 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:33.557463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.557966 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.558394 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.559406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.560044 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.560757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.614563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-60f4d7a1-8563-4d25-8267-1b79d616a6ac tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/ips" status: 200 len: 152 microversion: 2.20 time: 0.160790 Sep 08 16:13:33.615850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 363/755] 10.222.0.27 () {60 vars in 1289 bytes} [Thu Sep 8 16:13:33 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/ips => generated 152 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:13:33.625205 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:33.626044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:33.634804 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.635593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.635931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.636705 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:33.637348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:33.637898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:33.738774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:33.756157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d469b0f5-12e0-4274-8242-b11e7827fba4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1290 microversion: 2.1 time: 0.135916 Sep 08 16:13:33.757045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 393/756] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:33 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1290 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:34.315416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:34.316080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:34.322512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:34.322997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:34.323422 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:34.330406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:34.330406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:34.330406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:34.511393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:34.520121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ea8c348f-6e11-4633-82d8-4d8c798a7a13 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.209046 Sep 08 16:13:34.521272 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 364/757] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:34 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:34.779975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:34.780616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:34.787332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:34.787901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:34.788322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:34.788978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:34.789769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:34.790218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:34.862805 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:34.871025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9800f26f-8f69-43d9-b062-3ffe9ae790c4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1296 microversion: 2.1 time: 0.094904 Sep 08 16:13:34.871784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 394/758] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:34 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:35.546816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:35.547542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:35.555048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.555810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.556437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:35.557305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.558101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.558684 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:35.683358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:35.684284 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:35.695686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.697664 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.698379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:35.699254 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.699749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.700364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:35.725877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lazy-loading 'flavor' on Instance uuid 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:35.769846 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:35.778742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9b3c7ac9-0291-4034-a967-ddc01aa6116c tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1367 microversion: 2.1 time: 0.240054 Sep 08 16:13:35.794800 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 365/759] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:35 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:35.898519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:35.899395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:35.907186 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.908007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.908564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:35.909468 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.910089 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.910730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:35.967308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5fe92b03-779e-439f-982b-e13372a280c9 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/action" status: 202 len: 0 microversion: 2.20 time: 0.288350 Sep 08 16:13:35.975021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 395/760] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 16:13:35 2022] POST /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 16:13:35.980948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-ad73cf48-e426-4883-8eec-936049ff7cd2 req-413b95e8-f312-4991-a6ce-101f06b72613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbb14de-4ea7-471b-8a67-ea775d53954b", "tag": "42120762-d5ef-4d2e-950e-e28a2a6cfca5"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:35.997084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ad73cf48-e426-4883-8eec-936049ff7cd2 req-413b95e8-f312-4991-a6ce-101f06b72613 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:35.997995 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ad73cf48-e426-4883-8eec-936049ff7cd2 req-413b95e8-f312-4991-a6ce-101f06b72613 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:35.998580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ad73cf48-e426-4883-8eec-936049ff7cd2 req-413b95e8-f312-4991-a6ce-101f06b72613 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:36.012228 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-ad73cf48-e426-4883-8eec-936049ff7cd2 req-413b95e8-f312-4991-a6ce-101f06b72613 service nova] Creating event network-changed:42120762-d5ef-4d2e-950e-e28a2a6cfca5 for instance 6cbb14de-4ea7-471b-8a67-ea775d53954b on hv-cinder-85625 Sep 08 16:13:36.020588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-ad73cf48-e426-4883-8eec-936049ff7cd2 req-413b95e8-f312-4991-a6ce-101f06b72613 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043698 Sep 08 16:13:36.021796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 396/761] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:36.027276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:36.028011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:36.035027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:36.035783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:36.036441 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:36.037329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:36.037876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:36.038195 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:36.161616 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:36.177512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:36.178815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-905e6ed9-d1cf-46b5-9a3c-759fcb2cba51 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.288213 Sep 08 16:13:36.189175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:36.191527 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:36.193130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-11802757-0d3e-40ae-8e8f-02b000e6b42b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.170058 Sep 08 16:13:36.193804 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 397/762] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:36 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:36.201568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 366/763] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:35 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:36.801922 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:36.802532 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:36.808933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:36.809404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:36.809832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:36.810508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:36.810923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:36.811354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:36.944549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:36.952671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7104e861-c351-47cb-836d-ab6aecc89d67 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1557 microversion: 2.1 time: 0.154597 Sep 08 16:13:36.953261 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 398/764] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:36 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:36.975938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:36.976619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:36.983485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:36.983929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:36.984369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:36.985067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:36.985525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:36.985940 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:37.077514 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8452f13e-3b76-4da5-951c-06a7a17007d7 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105531 Sep 08 16:13:37.078104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 367/765] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:13:36 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:37.202438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:37.203039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:37.209592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:37.210198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:37.210636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:37.211477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:37.213603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:37.213948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:37.219158 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:37.219795 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:37.226382 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:37.227134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:37.227600 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:37.228302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:37.229074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:37.229695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:37.445565 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:37.469662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-856fbd0b-3160-4a91-a083-51984d48b08f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.270623 Sep 08 16:13:37.470564 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 399/766] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:37 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:37.877098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:37.886942 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:37.888822 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:37.890266 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-42e2f4d3-7ae3-4099-b1bb-1328bcf91e68 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.675309 Sep 08 16:13:37.890877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 368/767] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:37 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:38.493248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:38.493851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:38.497695 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:38.501516 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:38.502117 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:38.502644 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:38.503343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:38.503828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:38.504248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:38.661748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:38.672473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-60b2f962-1271-4bac-9e1d-11be9bcae7e7 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.183162 Sep 08 16:13:38.673428 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 400/768] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:38 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:38.847629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-ed7cfc94-6aad-4bb6-8c01-2704bbd7fb3f req-278f8048-6a76-4c1e-bde3-a4a2b632cc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7a000b-14e1-44c6-a9c7-6b485a91c350", "tag": "ea042f6a-f127-410f-8d28-d13b783df768"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:38.858023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ed7cfc94-6aad-4bb6-8c01-2704bbd7fb3f req-278f8048-6a76-4c1e-bde3-a4a2b632cc7f service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:38.858779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ed7cfc94-6aad-4bb6-8c01-2704bbd7fb3f req-278f8048-6a76-4c1e-bde3-a4a2b632cc7f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:38.859302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-ed7cfc94-6aad-4bb6-8c01-2704bbd7fb3f req-278f8048-6a76-4c1e-bde3-a4a2b632cc7f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:38.870771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-ed7cfc94-6aad-4bb6-8c01-2704bbd7fb3f req-278f8048-6a76-4c1e-bde3-a4a2b632cc7f service nova] Creating event network-changed:ea042f6a-f127-410f-8d28-d13b783df768 for instance af7a000b-14e1-44c6-a9c7-6b485a91c350 on hv-cinder-85625 Sep 08 16:13:38.875948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-ed7cfc94-6aad-4bb6-8c01-2704bbd7fb3f req-278f8048-6a76-4c1e-bde3-a4a2b632cc7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032448 Sep 08 16:13:38.876544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 369/769] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:38.919084 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:38.920096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:38.926723 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:38.927505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:38.928241 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:38.929385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:38.930155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:38.930866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:39.089338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:39.102592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:39.104570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:39.106619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b2361e3b-252b-48ff-b2d5-a6efa0aeaee4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.191831 Sep 08 16:13:39.107773 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 401/770] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:38 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:39.698061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:39.698941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:39.706955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:39.707590 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:39.707889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:39.708666 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:39.709098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:39.709572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:39.862441 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:39.870407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1147dc78-f95f-4462-9427-092739134a8c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.177442 Sep 08 16:13:39.871365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 370/771] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:39 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:40.132392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:40.133222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:40.140491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:40.141404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:40.142200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:40.143796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:40.152965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:40.153440 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:40.329872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:40.338949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:40.341392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:40.342770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-50f518ad-06e5-4c2d-8b6c-da3d7ad357a5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.214407 Sep 08 16:13:40.343318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 402/772] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:40 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:40.893150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:40.896977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:40.903841 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:40.904356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:40.904772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:40.905475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:40.905986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:40.906356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:40.957758 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:40.959385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:40.966309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:40.967576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:40.968092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:40.968841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:40.969514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:40.969936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:41.001281 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:13:41.058082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:41.067655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a6b2db95-a917-45b2-bb3e-36fa362f694e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.177982 Sep 08 16:13:41.067655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 371/773] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:40 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:41.088812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b66ee8c7-a5af-4ac4-808b-a207b6d17fcd tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 204 len: 0 microversion: 2.1 time: 0.136118 Sep 08 16:13:41.091128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 403/774] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:13:40 2022] DELETE /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 16:13:41.099196 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:41.099979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:41.106197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:41.106798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:41.107302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:41.108085 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:41.108619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:41.109130 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:41.258913 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:41.266841 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9797ec8f-a31d-4e56-b5ec-827c9885996c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1576 microversion: 2.1 time: 0.171667 Sep 08 16:13:41.267407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 372/775] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:41 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:41.373041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:41.374117 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:41.384123 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:41.385197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:41.386464 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:41.387541 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:41.388102 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:41.388987 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:41.479015 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-2a7cd669-ed64-4e75-9baf-62b8a2cf3a61 req-e4583a1c-1536-4c33-a9b3-b025baf6d031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbb14de-4ea7-471b-8a67-ea775d53954b", "name": "network-vif-plugged", "status": "completed", "tag": "42120762-d5ef-4d2e-950e-e28a2a6cfca5"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:41.489627 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-2a7cd669-ed64-4e75-9baf-62b8a2cf3a61 req-e4583a1c-1536-4c33-a9b3-b025baf6d031 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:41.490101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-2a7cd669-ed64-4e75-9baf-62b8a2cf3a61 req-e4583a1c-1536-4c33-a9b3-b025baf6d031 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:41.490522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-2a7cd669-ed64-4e75-9baf-62b8a2cf3a61 req-e4583a1c-1536-4c33-a9b3-b025baf6d031 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:41.495852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:41.504345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-2a7cd669-ed64-4e75-9baf-62b8a2cf3a61 req-e4583a1c-1536-4c33-a9b3-b025baf6d031 service nova] Creating event network-vif-plugged:42120762-d5ef-4d2e-950e-e28a2a6cfca5 for instance 6cbb14de-4ea7-471b-8a67-ea775d53954b on hv-cinder-85625 Sep 08 16:13:41.509914 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-2a7cd669-ed64-4e75-9baf-62b8a2cf3a61 req-e4583a1c-1536-4c33-a9b3-b025baf6d031 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165615 Sep 08 16:13:41.510749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 404/776] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:41.538755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:41.548165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:41.549618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:41.550807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0d8ba0fd-3efa-4c72-ba1d-997d0a29de76 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.184139 Sep 08 16:13:41.551373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 373/777] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:41 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:42.091234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:42.091976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:42.100145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:42.100661 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:42.101211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:42.102019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:42.102496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:42.102917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:42.253738 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:42.261594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-33b4783c-3e8f-43a6-8b01-a398d9d8c083 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.174858 Sep 08 16:13:42.262170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 405/778] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:42 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:42.291965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:42.292674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:42.300150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:42.300824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:42.301521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:42.302570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:42.303223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:42.304410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:42.333215 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:42.396507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:42.417651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:42.483662 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:42.491713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4299a5ea-32dc-4ac0-90db-a2e411b4c0fc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1576 microversion: 2.1 time: 0.204281 Sep 08 16:13:42.492552 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 374/779] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:42 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:42.577205 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:42.577949 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:42.585509 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:42.586126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:42.586614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:42.587584 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:42.588100 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:42.588671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:42.595505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=6 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:42.727735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:42.736474 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:42.737956 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:42.739118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b908a49a-20f1-4411-b52b-df4da9e00dba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.166175 Sep 08 16:13:42.739818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 406/780] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:42 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:43.288225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:43.288895 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:43.294969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.295606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.295909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.296803 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.297262 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.297686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.515254 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:43.515964 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:43.522242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.522824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.523371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.524154 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.524678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.525158 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.552928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:43.573383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b83a2bf-ea36-466b-b2da-0170445b868e tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1364 microversion: 2.1 time: 0.292461 Sep 08 16:13:43.589625 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 375/781] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:43 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:43.605903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:43.614176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d23148e2-f543-44dc-b048-3b5e899844f8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1509 microversion: 2.1 time: 0.103426 Sep 08 16:13:43.614763 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 407/782] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:43 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1509 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:13:43.765048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:43.766084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:43.775346 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.778514 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.779216 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.780223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.780902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.785539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.812160 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-96ea6b63-3a12-4fc8-a5ea-27a573b47db8 req-c7e57a9a-d26b-4c7c-b765-a4efff55db0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dfe24f-aaf4-47c1-8f58-017da860325c", "name": "network-vif-deleted", "tag": "014b0d74-7376-4159-8207-1355dff59ef4"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:43.822129 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-96ea6b63-3a12-4fc8-a5ea-27a573b47db8 req-c7e57a9a-d26b-4c7c-b765-a4efff55db0d service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:43.822610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-96ea6b63-3a12-4fc8-a5ea-27a573b47db8 req-c7e57a9a-d26b-4c7c-b765-a4efff55db0d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:43.823026 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-96ea6b63-3a12-4fc8-a5ea-27a573b47db8 req-c7e57a9a-d26b-4c7c-b765-a4efff55db0d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:43.836660 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-96ea6b63-3a12-4fc8-a5ea-27a573b47db8 req-c7e57a9a-d26b-4c7c-b765-a4efff55db0d service nova] Creating event network-vif-deleted:014b0d74-7376-4159-8207-1355dff59ef4 for instance 08dfe24f-aaf4-47c1-8f58-017da860325c on hv-cinder-85625 Sep 08 16:13:43.855203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-96ea6b63-3a12-4fc8-a5ea-27a573b47db8 req-c7e57a9a-d26b-4c7c-b765-a4efff55db0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046681 Sep 08 16:13:43.856144 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 408/783] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:43.987756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:44.001180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:44.005043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:44.008487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4b5de63f-d727-4e92-a221-088bb2fcebfb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.246642 Sep 08 16:13:44.011050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 376/784] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:43 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:44.600253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:44.600953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:44.607913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.609032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.609540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.610240 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.610702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.611129 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.638386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:44.639021 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:44.645526 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.646019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.646456 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.647181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.652310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.652825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.689529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.690020 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.690632 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.691260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lazy-loading 'fault' on Instance uuid 08dfe24f-aaf4-47c1-8f58-017da860325c {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:13:44.734002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:44.742278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a2165f49-f059-4f67-adac-438496ef8865 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 200 len: 1230 microversion: 2.1 time: 0.108060 Sep 08 16:13:44.743070 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 377/785] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:44 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:44.756620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:44.764672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b3b0e66c-fd68-461c-a39d-b306b234831f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1549 microversion: 2.1 time: 0.168778 Sep 08 16:13:44.765439 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 409/786] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:44 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:44.787363 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:44.787904 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:44.794441 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.794925 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.795354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.796092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:44.796536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:44.796949 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:44.882910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-48dec750-3743-4403-abb6-cd67915834d4 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098990 Sep 08 16:13:44.883565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 378/787] 10.222.0.27 () {58 vars in 1275 bytes} [Thu Sep 8 16:13:44 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:45.036172 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:45.036902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:45.043147 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:45.043675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:45.044110 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:45.044803 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:45.045257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:45.045681 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:45.288329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:45.302301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:45.303876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:45.305169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fca419fa-1a6b-4167-9c4c-1f3d5146e061 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.272996 Sep 08 16:13:45.305891 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 410/788] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:45 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:45.766524 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:45.767808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:45.774703 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:45.775364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:45.775962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:45.776822 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:45.777469 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:45.778041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:45.792097 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] HTTP exception thrown: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Request method failure captured: Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c HTTP/1.1 Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhPri3mzaSAG2ls7Qc10A2LBHxJWjfwV7Qg8n0GafcSQ_iEieNdBgLw9h29VkM29jCSKaXsUUONNnPH7XsoUwPFeweItJJQZqr0XkQQo1fi5WlJvrSkGeZDC68kMiQD_SMxaJeCJyzJzTDFvDVLhfCkAdkpoXwWf6acxGtUdZpSaaEw Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:13:45.793751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53275b4dc845465d8b0bfb50eacd14f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}] Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestVolumeBootPattern-959899855 Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 77aeaed3d55945e49b0eb6e3c0519294 Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:13:45.795299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '08dfe24f-aaf4-47c1-8f58-017da860325c'} Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:13:45.796353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:13:45.797923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:13:45.799286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Returning 404 to user: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:13:45.799286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c04b0b5d-e318-4818-bacb-cb6c00052ddc tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 404 len: 111 microversion: 2.1 time: 0.033171 Sep 08 16:13:45.799286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 379/789] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:45 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:13:45.927802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-647515588", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1361964657", "security_groups": [{"name": "tempest-secgroup-smoke-350650337"}], "block_device_mapping_v2": [{"uuid": "8305755e-f391-4224-8f92-7cf080594562", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5102509-85cc-4d13-8399-20742dacc4a9"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:46.058019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-4f572e79-25d8-4429-aa1c-54caa7ea2c9a req-d700d0b8-7942-4a82-8e1d-70fa1655c07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbb14de-4ea7-471b-8a67-ea775d53954b", "tag": "42120762-d5ef-4d2e-950e-e28a2a6cfca5"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:46.068573 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4f572e79-25d8-4429-aa1c-54caa7ea2c9a req-d700d0b8-7942-4a82-8e1d-70fa1655c07d service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:46.069062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4f572e79-25d8-4429-aa1c-54caa7ea2c9a req-d700d0b8-7942-4a82-8e1d-70fa1655c07d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:46.069485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4f572e79-25d8-4429-aa1c-54caa7ea2c9a req-d700d0b8-7942-4a82-8e1d-70fa1655c07d service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:46.078532 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] validate_networks() for [('f5102509-85cc-4d13-8399-20742dacc4a9', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:13:46.088009 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-4f572e79-25d8-4429-aa1c-54caa7ea2c9a req-d700d0b8-7942-4a82-8e1d-70fa1655c07d service nova] Creating event network-changed:42120762-d5ef-4d2e-950e-e28a2a6cfca5 for instance 6cbb14de-4ea7-471b-8a67-ea775d53954b on hv-cinder-85625 Sep 08 16:13:46.093214 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-4f572e79-25d8-4429-aa1c-54caa7ea2c9a req-d700d0b8-7942-4a82-8e1d-70fa1655c07d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203778 Sep 08 16:13:46.093834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 411/790] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:46.332508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:46.333522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:46.340659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:46.341364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:46.341859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:46.342884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:46.343814 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:46.344311 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:46.501674 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:46.510583 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:46.512037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:46.513229 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-607e6d53-ceb5-481f-8906-979ac8b8e1ff tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.185212 Sep 08 16:13:46.513794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 412/791] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:46 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:13:46.966679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:13:46.967202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:13:46.967669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:13:46.968077 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:13:46.968485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:13:46.982192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:46.982934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:46.983582 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:46.984488 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:46.985134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:46.985726 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:47.005197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:13:47.009647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for user 77aeaed3d55945e49b0eb6e3c0519294 and project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:13:47.076223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:13:47.078707 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8305755e-f391-4224-8f92-7cf080594562',volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:13:47.208435 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:47.250012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3b10fcae-f85e-4d73-a01e-98571141be5c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.327107 Sep 08 16:13:47.251344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 380/792] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:13:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:13:47.263353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-96f3f524-71ec-493b-846f-78c21bf92c4c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:47.263996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-96f3f524-71ec-493b-846f-78c21bf92c4c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:47.351301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-96f3f524-71ec-493b-846f-78c21bf92c4c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:47.358944 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-96f3f524-71ec-493b-846f-78c21bf92c4c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1094 microversion: 2.1 time: 0.099940 Sep 08 16:13:47.359546 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 413/793] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:47 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:47.539286 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:47.540176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:47.547668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:47.548567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:47.549002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:47.549764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:47.550228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:47.550855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:47.709159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:47.718358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:47.719813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:47.721639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b0f051c5-e891-4ee8-a04f-4fc6dd389dcb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.187436 Sep 08 16:13:47.722225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 381/794] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:47 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:48.384331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:48.384952 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:48.392958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:48.393579 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:48.394112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:48.395525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:48.396049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:48.396686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:48.469873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:48.477849 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-89c3bf4d-adb2-46e6-90de-6e307ffe27db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1200 microversion: 2.1 time: 0.098949 Sep 08 16:13:48.478426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 414/795] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:48 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:48.750350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:48.750989 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:48.762270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:48.762740 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:48.767676 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:48.768477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:48.768948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:48.769389 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:49.007835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:49.016993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:49.018954 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:49.020255 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9179bb55-49c2-49f6-b4ff-685e51ef0fcc tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.274628 Sep 08 16:13:49.039780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 382/796] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:48 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:49.502551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:49.503999 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:49.511675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:49.512373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:49.512969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:49.513939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:49.514625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:49.515354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:49.666102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:49.674309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-47d475e0-3585-4795-b2c1-674fc5990315 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.177817 Sep 08 16:13:49.675018 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 415/797] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:49 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:50.047423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:50.048688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:50.057545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:50.058664 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:50.060547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:50.061833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:50.062961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:50.063706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:50.085302 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-4c15e8cf-c30f-498b-833b-a6b8d02289d9 req-0b161bea-05c5-4ffc-9aa5-f76c4c5c19b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86f2f9b4-bf6c-45b3-b927-41d825203a5d", "tag": "83311939-ae7e-4703-90a1-f4c265746217"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:50.125805 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4c15e8cf-c30f-498b-833b-a6b8d02289d9 req-0b161bea-05c5-4ffc-9aa5-f76c4c5c19b7 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:50.126631 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4c15e8cf-c30f-498b-833b-a6b8d02289d9 req-0b161bea-05c5-4ffc-9aa5-f76c4c5c19b7 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:50.127263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4c15e8cf-c30f-498b-833b-a6b8d02289d9 req-0b161bea-05c5-4ffc-9aa5-f76c4c5c19b7 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:50.141104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-4c15e8cf-c30f-498b-833b-a6b8d02289d9 req-0b161bea-05c5-4ffc-9aa5-f76c4c5c19b7 service nova] Creating event network-changed:83311939-ae7e-4703-90a1-f4c265746217 for instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d on hv-cinder-85625 Sep 08 16:13:50.147629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-4c15e8cf-c30f-498b-833b-a6b8d02289d9 req-0b161bea-05c5-4ffc-9aa5-f76c4c5c19b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074195 Sep 08 16:13:50.148959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 416/798] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:13:50.463228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:50.472641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:50.473979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:50.475163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-10702398-bd65-4c78-9acb-01d4d48de463 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.432679 Sep 08 16:13:50.475997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 383/799] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:50 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:50.699050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:50.699903 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:50.706700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:50.707185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:50.707647 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:50.708670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:50.709125 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:50.709576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:50.844890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:50.853941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5a2f25d-d8f5-4048-8950-fd9f5d0fe92f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.159184 Sep 08 16:13:50.854534 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 417/800] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:50 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:51.506003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:51.506561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:51.513374 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:51.513865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:51.514298 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:51.514992 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:51.515474 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:51.515909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:51.650523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:51.663388 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:51.664943 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:51.666090 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-04c3deb5-9239-4de7-aefb-7433a7cc3468 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1744 microversion: 2.20 time: 0.164269 Sep 08 16:13:51.666689 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 384/801] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:51 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:51.883462 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:51.884216 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:51.892593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:51.893190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:51.893721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:51.894567 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:51.895123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:51.895689 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:52.273716 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:52.281395 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c4d19f4e-dc91-4633-8a82-f6097f9e0651 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.404343 Sep 08 16:13:52.281959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 418/802] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:51 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:52.695979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:52.696674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:52.703680 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:52.704165 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:52.704596 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:52.705285 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:52.705737 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:52.706157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:52.848674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:52.857211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:52.858639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:52.859843 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bb5676bc-6049-4af0-a623-739bb8a36c36 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1744 microversion: 2.20 time: 0.169478 Sep 08 16:13:52.860407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 385/803] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:52 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:53.304917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:53.306213 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:53.312935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:53.313383 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:53.313902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:53.314598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:53.315067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:53.315996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:53.461983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:53.470696 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cfae7144-62b8-4528-8a23-a7c252b4cfb4 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.171152 Sep 08 16:13:53.471522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 419/804] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:53 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:53.885025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:53.885643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:53.894775 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:53.895267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:53.895731 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:53.896505 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:53.896883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:53.897310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:54.065426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:54.076560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:54.078187 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:54.079368 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-07091885-53b7-49a5-8cf0-262f92b7a0fd tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.198334 Sep 08 16:13:54.079975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 386/805] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:53 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:54.494308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:54.494880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:54.511703 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:54.512489 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:54.512915 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:54.513956 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:54.514426 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:54.514829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:54.667915 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:54.676227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f2ba2cfa-e4e1-447c-b99d-deaf44280072 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.185763 Sep 08 16:13:54.691486 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 420/806] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:54 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:55.107033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:55.108287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:55.115009 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:55.115708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:55.116314 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:55.117282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:55.117899 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:55.118473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:55.336665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:55.346452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:55.354353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:55.356019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a6f00efe-f300-4778-87fe-03aa98d1bc2b tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.252882 Sep 08 16:13:55.357116 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 387/807] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:55 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:55.537449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-d8fb8db8-d908-4234-8192-102d7c4fd24a req-49a783cc-5a46-4a20-af0a-9823d95abaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "name": "network-vif-plugged", "status": "completed", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:13:55.549708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d8fb8db8-d908-4234-8192-102d7c4fd24a req-49a783cc-5a46-4a20-af0a-9823d95abaed service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:55.550489 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d8fb8db8-d908-4234-8192-102d7c4fd24a req-49a783cc-5a46-4a20-af0a-9823d95abaed service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:55.551122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-d8fb8db8-d908-4234-8192-102d7c4fd24a req-49a783cc-5a46-4a20-af0a-9823d95abaed service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:55.577836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-d8fb8db8-d908-4234-8192-102d7c4fd24a req-49a783cc-5a46-4a20-af0a-9823d95abaed service nova] Creating event network-vif-plugged:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:13:55.589480 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-d8fb8db8-d908-4234-8192-102d7c4fd24a req-49a783cc-5a46-4a20-af0a-9823d95abaed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055602 Sep 08 16:13:55.591226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 421/808] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:13:55.701008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:55.701614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:55.708120 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:55.708836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:55.709587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:55.710542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:55.711191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:55.711868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:55.879718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:55.889064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0ec31133-5f5e-413a-8142-8556f1ab178f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.191936 Sep 08 16:13:55.896003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 388/809] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:55 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:56.389275 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:56.389965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:56.400524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:56.402675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:56.403287 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:56.404020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:56.404473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:56.404896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:56.575178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:56.585561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:56.587328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:56.588812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ea851a43-91ab-45c9-a604-fe29dc70ffd0 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.204407 Sep 08 16:13:56.607153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 422/810] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:56 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:56.913647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:56.915390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:56.924746 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:56.925696 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:56.926136 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:56.927051 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:56.927531 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:56.927957 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:56.996816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:57.018975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:57.109929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:57.118695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-49cf3753-3926-4595-bb03-55d75089247c tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.209994 Sep 08 16:13:57.119668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 389/811] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:56 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:57.614610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:57.615331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:57.617687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:13:57.625032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:57.625032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:57.625549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:57.626309 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:57.626864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:57.627346 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:57.773308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:57.781974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:57.783503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:57.786902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-788adecc-f23b-4e3e-ad50-9d0dcfe3db75 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.176390 Sep 08 16:13:57.799512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 423/812] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:57 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:58.142500 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:58.143113 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:58.150512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:58.151832 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:58.152568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:58.153429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:58.154051 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:58.154636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:58.320842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:58.329195 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-26f87b9b-d589-4b01-a609-d22e48edac96 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.190486 Sep 08 16:13:58.343915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 390/813] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:58 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:13:58.814044 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:58.814607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:58.821465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:58.821951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:58.822378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:58.823072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:58.823541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:58.823927 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:58.983767 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:58.993273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:58.994694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:58.995884 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-194337c8-5f44-41e9-84a5-48b9d14277da tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.186278 Sep 08 16:13:58.996446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 424/814] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:13:58 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:13:59.353484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:13:59.354352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:13:59.382311 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:59.383179 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:59.389713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:59.391638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:13:59.392282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:13:59.392853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:13:59.626212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:13:59.635708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b7bf3ae-be45-42b4-b4c2-eee2b78b7142 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.288113 Sep 08 16:13:59.637065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 391/815] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:13:59 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:00.026908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:00.029017 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:00.045016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:00.046167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:00.046774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:00.049500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:00.050551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:00.051162 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:00.113521 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:00.283077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:00.293880 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:00.295508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:00.296839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-328fa423-9044-4dc1-a6b8-3dc008209368 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.279194 Sep 08 16:14:00.300160 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 425/816] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:00 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:00.658588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:00.659312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:00.665761 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:00.666538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:00.667066 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:00.667828 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:00.668500 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:00.669004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:00.685293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:00.816148 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:00.826955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-685bd19e-d341-4e0d-b61f-1de34d9486bb tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.172485 Sep 08 16:14:00.827562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 392/817] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:00 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:01.342031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:01.342655 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:01.351001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:01.351512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:01.352021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:01.352923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:01.354119 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:01.354764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:01.538953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:01.548550 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:01.549971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:01.551151 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1bbd580b-68d6-470c-9c0f-71b7cb65b317 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.229925 Sep 08 16:14:01.576588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-96ea05aa-111c-473a-a955-bbcd34b0dd9b req-f8756b1c-99c6-4f92-9bd4-de93639e4e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f2f9b4-bf6c-45b3-b927-41d825203a5d", "name": "network-vif-plugged", "status": "completed", "tag": "83311939-ae7e-4703-90a1-f4c265746217"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:01.581836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 426/818] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:01 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:01.588630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-96ea05aa-111c-473a-a955-bbcd34b0dd9b req-f8756b1c-99c6-4f92-9bd4-de93639e4e45 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:01.589175 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-96ea05aa-111c-473a-a955-bbcd34b0dd9b req-f8756b1c-99c6-4f92-9bd4-de93639e4e45 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:01.589712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-96ea05aa-111c-473a-a955-bbcd34b0dd9b req-f8756b1c-99c6-4f92-9bd4-de93639e4e45 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:01.604918 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-96ea05aa-111c-473a-a955-bbcd34b0dd9b req-f8756b1c-99c6-4f92-9bd4-de93639e4e45 service nova] Creating event network-vif-plugged:83311939-ae7e-4703-90a1-f4c265746217 for instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d on hv-cinder-85625 Sep 08 16:14:01.612686 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-96ea05aa-111c-473a-a955-bbcd34b0dd9b req-f8756b1c-99c6-4f92-9bd4-de93639e4e45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039293 Sep 08 16:14:01.613444 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 393/819] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:01.856187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:01.856789 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:01.864773 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:01.872606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:01.873421 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:01.874470 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:01.875130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:01.875800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:02.050342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:02.058687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-19ea2ef4-b097-4fc9-abca-7bec21902970 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.206651 Sep 08 16:14:02.060178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 427/820] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:01 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:02.579550 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:02.581188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:02.590002 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:02.590617 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:02.591060 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:02.591786 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:02.592266 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:02.592689 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:02.743736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:02.752883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:02.754328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:02.755587 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f857f6e3-98dd-4246-b54a-ae6b7640aa27 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.180871 Sep 08 16:14:02.756440 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 394/821] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:02 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:03.081871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:03.082478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:03.089710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:03.090075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:03.090512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:03.091372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:03.091910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:03.092355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:03.282769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:03.292182 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-646d61b5-4cfe-4b7c-bc8a-db9bd453bb15 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1265 microversion: 2.1 time: 0.214079 Sep 08 16:14:03.293322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 428/822] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:03 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:03.786098 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:03.787041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:03.794276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:03.794741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:03.795189 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:03.795902 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:03.796355 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:03.796791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:03.932295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:03.940999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:03.942412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:03.943608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-96de2981-c243-4586-aa77-00967e685f93 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1739 microversion: 2.20 time: 0.164232 Sep 08 16:14:03.944171 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 395/823] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:03 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:04.319500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:04.320102 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:04.327385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:04.327928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:04.328363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:04.329122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:04.329597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:04.330048 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:04.471040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:04.479878 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cb91fa64-173d-40b7-a7bd-f6fb6db7e5e9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1451 microversion: 2.1 time: 0.165869 Sep 08 16:14:04.483630 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 429/824] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:04 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:04.502263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:04.502910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:04.509132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:04.509560 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:04.509996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:04.510690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:04.511149 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:04.511606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:04.682545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:04.690809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0c717dc5-9e2e-4af9-84f7-4a3c0a4f0c2b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1451 microversion: 2.1 time: 0.192565 Sep 08 16:14:04.691400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 396/825] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:04 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1451 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:04.971070 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:04.971697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:04.977912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:04.978376 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:04.979062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:04.979873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:04.980503 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:04.980960 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:05.175461 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:05.184671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:05.186349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:05.188019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e53bc72c-cb45-4f7f-b704-6e4907df2566 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1721 microversion: 2.20 time: 0.221200 Sep 08 16:14:05.188690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 430/826] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:04 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:06.214998 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:06.215653 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:06.222381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:06.222855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:06.223289 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:06.224012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:06.224463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:06.224883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:06.358619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-b6a6dc15-f78f-46d7-9f5d-ba7642981cbe req-e2132672-be2c-4fd3-bedf-9a7fa60766c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86f2f9b4-bf6c-45b3-b927-41d825203a5d", "tag": "83311939-ae7e-4703-90a1-f4c265746217"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:06.360944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:06.369556 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b6a6dc15-f78f-46d7-9f5d-ba7642981cbe req-e2132672-be2c-4fd3-bedf-9a7fa60766c0 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:06.370031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b6a6dc15-f78f-46d7-9f5d-ba7642981cbe req-e2132672-be2c-4fd3-bedf-9a7fa60766c0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:06.370546 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:06.370692 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b6a6dc15-f78f-46d7-9f5d-ba7642981cbe req-e2132672-be2c-4fd3-bedf-9a7fa60766c0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:06.372083 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:06.373469 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-658dac60-88c9-4cb0-bb25-55f846398196 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1721 microversion: 2.20 time: 0.162494 Sep 08 16:14:06.374034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 397/827] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:06 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:06.390720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-b6a6dc15-f78f-46d7-9f5d-ba7642981cbe req-e2132672-be2c-4fd3-bedf-9a7fa60766c0 service nova] Creating event network-changed:83311939-ae7e-4703-90a1-f4c265746217 for instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d on hv-cinder-85625 Sep 08 16:14:06.395828 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-b6a6dc15-f78f-46d7-9f5d-ba7642981cbe req-e2132672-be2c-4fd3-bedf-9a7fa60766c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041370 Sep 08 16:14:06.396435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 431/828] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:07.401421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:07.402049 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:07.414234 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:07.417621 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:07.418112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:07.418872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:07.420746 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:07.421005 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:07.496435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-ae2c2e51-2e73-4bf6-8a6a-3d6e06905e73 req-7fce5a74-cfd5-4f7d-ad84-7d9ee0e887af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "name": "network-vif-unplugged", "status": "completed", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:07.509392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ae2c2e51-2e73-4bf6-8a6a-3d6e06905e73 req-7fce5a74-cfd5-4f7d-ad84-7d9ee0e887af service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:07.509392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ae2c2e51-2e73-4bf6-8a6a-3d6e06905e73 req-7fce5a74-cfd5-4f7d-ad84-7d9ee0e887af service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:07.509392 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-ae2c2e51-2e73-4bf6-8a6a-3d6e06905e73 req-7fce5a74-cfd5-4f7d-ad84-7d9ee0e887af service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:07.528766 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-ae2c2e51-2e73-4bf6-8a6a-3d6e06905e73 req-7fce5a74-cfd5-4f7d-ad84-7d9ee0e887af service nova] Creating event network-vif-unplugged:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:14:07.537383 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-ae2c2e51-2e73-4bf6-8a6a-3d6e06905e73 req-7fce5a74-cfd5-4f7d-ad84-7d9ee0e887af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046132 Sep 08 16:14:07.538108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 432/829] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:14:07.865432 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:07.876423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:07.878522 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:07.880035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a15dc704-0054-4c17-a589-871256159869 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1724 microversion: 2.20 time: 0.485194 Sep 08 16:14:07.880705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 398/830] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:07 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1724 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:07.909748 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ad40304-7d4d-4d98-8922-d37a076ed4ad"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:07.912333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:07.918936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:07.919524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:07.920032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:07.920788 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:07.921305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:07.921825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:08.281982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0d4502af-a53d-4de7-93c1-c0c75bf99e62 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.377905 Sep 08 16:14:08.282943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 433/831] 10.222.0.27 () {62 vars in 1364 bytes} [Thu Sep 8 16:14:07 2022] POST /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-volume_attachments => generated 188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 16:14:08.415700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:08.416223 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:08.422540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:08.423015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:08.423482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:08.424211 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:08.424598 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:08.425011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:08.678721 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b59930b9-9f7d-43c4-b82b-bdb1880ec362 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-volume_attachments/8ad40304-7d4d-4d98-8922-d37a076ed4ad" status: 202 len: 0 microversion: 2.20 time: 0.266908 Sep 08 16:14:08.682601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 399/832] 10.222.0.27 () {60 vars in 1457 bytes} [Thu Sep 8 16:14:08 2022] DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-volume_attachments/8ad40304-7d4d-4d98-8922-d37a076ed4ad => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:14:08.744768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:08.745364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:08.747806 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:08.754216 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:08.754749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:08.755163 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:08.755895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:08.756350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:08.756820 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:08.787465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120783) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 16:14:08.857603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-41d08bf9-2e6b-408d-aaff-5324da98542e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "POST /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/action" status: 202 len: 0 microversion: 2.20 time: 0.116608 Sep 08 16:14:08.858406 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 434/833] 10.222.0.27 () {62 vars in 1319 bytes} [Thu Sep 8 16:14:08 2022] POST /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:14:08.867251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:08.868478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:08.877794 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:08.878479 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:08.878980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:08.879767 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:08.880588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:08.881113 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:09.037892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:09.047692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:09.049335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:09.052355 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-692722bd-46b8-4e46-993f-3dbbd4e9e6eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1672 microversion: 2.20 time: 0.189679 Sep 08 16:14:09.053011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 400/834] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:08 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1672 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:10.081221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:10.082025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:10.089940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:10.090502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:10.090935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:10.091669 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:10.092087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:10.092536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:10.226869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:10.235415 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:10.236894 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:10.238131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-88681ebf-abf9-4f16-a9e1-0367f7858983 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.162089 Sep 08 16:14:10.238662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 435/835] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:10 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:11.264040 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:11.264790 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:11.271375 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:11.271892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:11.272319 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:11.273045 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:11.273488 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:11.273904 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:11.409997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:11.418326 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:11.419781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:11.420938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f9421cd8-3a74-45b1-b355-eb728df94cc4 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.160959 Sep 08 16:14:11.421496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 401/836] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:11 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:12.447139 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:12.447947 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:12.454799 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:12.455507 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:12.455941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:12.456636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:12.457081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:12.457525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:12.591404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:12.599995 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:12.601412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:12.602650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8d70f23d-9994-4ab2-939c-5043d706ddda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.160039 Sep 08 16:14:12.603215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 436/837] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:12 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:13.628638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:13.629202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:13.636094 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:13.636593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:13.637989 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:13.637989 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:13.638226 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:13.638595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:13.788509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:13.797083 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:13.798915 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:13.800119 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a6ec50bc-d542-4222-b8c1-6f6130e0b734 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.175594 Sep 08 16:14:13.800652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 402/838] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:13 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:14.828843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:14.829478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:14.840142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:14.840644 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:14.841075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:14.841791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:14.842232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:14.842655 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:14.997571 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:15.006053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:15.007518 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:15.008718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6e5b3196-b4f7-48b2-9cd6-7a250c57d7ba tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.186500 Sep 08 16:14:15.009280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 437/839] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:14 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:15.578153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:15.578909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:15.585656 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:15.586188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:15.586577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:15.587269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:15.587787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:15.588204 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:15.612149 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4abf15b2-f78e-45d3-9d8d-15fb748f07e1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/ips" status: 200 len: 149 microversion: 2.1 time: 0.037767 Sep 08 16:14:15.612688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 403/840] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:14:15 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:16.035007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:16.035813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:16.045398 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:16.046042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:16.046687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:16.047600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:16.048059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:16.048484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:16.198690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:16.208450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:16.210469 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:16.211909 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8ea2a4ba-e39a-4956-8cdd-63e63bb25a58 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.181455 Sep 08 16:14:16.212562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 438/841] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:16 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:16.990796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "937cc065-ef96-44fe-b068-823db7a43208"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:16.993269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:16.999961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:17.000445 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:17.000874 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:17.001550 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:17.002003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:17.002438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:17.239208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:17.239914 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:17.246215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:17.246702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:17.247135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:17.247865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:17.248376 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:17.248929 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:17.265461 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:17.408867 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:17.418259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:17.419762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:17.420948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ecaef2d1-33fc-47fa-9b43-d95ae77f7950 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.186558 Sep 08 16:14:17.421517 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 439/842] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:17 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:14:18.449297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:18.449983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:18.460671 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:18.461277 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:18.461839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:18.462838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:18.463479 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:18.464053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:18.603190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:18.611848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:18.613291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:18.614462 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6811d9d5-a1c0-4193-adc0-8862ab7c3481 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.169951 Sep 08 16:14:18.615026 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 440/843] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:18 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:19.647719 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:19.648557 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:19.655118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:19.655629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:19.656069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:19.656774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:19.657227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:19.657652 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:19.796185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:19.804864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:19.806327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:19.807634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5f34298c-18d1-43c3-bb74-cc0f61484447 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.163992 Sep 08 16:14:19.808633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 441/844] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:19 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:20.834268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:20.835089 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:20.853260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:20.853662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:20.854095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:20.854787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:20.855232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:20.855751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:20.992322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:21.000891 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:21.002327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:21.003524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ee750043-9968-4fbf-8400-1e8fea8ec740 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.173413 Sep 08 16:14:21.004266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 442/845] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:20 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:21.948430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-836687a1-44fb-42dc-8845-bbd127894829 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "POST /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.961391 Sep 08 16:14:21.949063 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 404/846] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:14:16 2022] POST /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments => generated 194 bytes in 4963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:22.030138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:22.030685 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:22.037516 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:22.038020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:22.038446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:22.039128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:22.039624 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:22.040038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:22.181448 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:22.190143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:22.191614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:22.192786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a3561187-0b3e-42be-928a-2603e34cb5fe tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.166658 Sep 08 16:14:22.193349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 443/847] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:22 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:23.219391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:23.220107 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:23.222822 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=49 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:23.229073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:23.229572 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:23.229993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:23.230695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:23.231144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:23.231601 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:23.376267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:23.384528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:23.385970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:23.387115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9b85f95d-3ef8-4260-9736-b400369eadda tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.172129 Sep 08 16:14:23.387714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 405/848] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:23 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:24.417085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:24.418088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:24.426529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:24.427010 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:24.427459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:24.428157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:24.428611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:24.429037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:24.558006 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:24.566800 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:24.568263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:24.569508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0c20b6aa-0b52-4e45-baf7-27b92e259a29 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.158996 Sep 08 16:14:24.570068 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 444/849] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:24 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:25.599883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:25.600896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:25.611877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:25.612681 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:25.613452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:25.614559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:25.615335 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:25.616101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:25.622661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:25.753110 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:25.762039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:25.763485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:25.764678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d87077a1-d133-48da-956d-0cbd6b6f193c tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.171711 Sep 08 16:14:25.765232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 406/850] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:25 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:25.867209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-52613ff3-2078-47a0-9465-f3062eb69c98 req-d477f3f9-2d1a-4c09-98c6-c48f67750298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "name": "network-vif-plugged", "status": "completed", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:25.878267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-52613ff3-2078-47a0-9465-f3062eb69c98 req-d477f3f9-2d1a-4c09-98c6-c48f67750298 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:25.878813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-52613ff3-2078-47a0-9465-f3062eb69c98 req-d477f3f9-2d1a-4c09-98c6-c48f67750298 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:25.879322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-52613ff3-2078-47a0-9465-f3062eb69c98 req-d477f3f9-2d1a-4c09-98c6-c48f67750298 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:25.890747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-52613ff3-2078-47a0-9465-f3062eb69c98 req-d477f3f9-2d1a-4c09-98c6-c48f67750298 service nova] Creating event network-vif-plugged:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:14:25.896132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-52613ff3-2078-47a0-9465-f3062eb69c98 req-d477f3f9-2d1a-4c09-98c6-c48f67750298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 Sep 08 16:14:25.898245 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 445/851] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:26.793290 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:26.794139 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:26.802209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:26.802630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:26.803078 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:26.803808 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:26.804270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:26.804697 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:26.946845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:26.955580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:26.957025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:26.958194 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b15f518a-6b32-415d-84e7-569149d285e5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.170691 Sep 08 16:14:26.958764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 407/852] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:26 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:27.995587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:27.997690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:28.005786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:28.006198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:28.006683 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:28.007374 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:28.007845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:28.008243 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:28.145098 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:28.153475 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:28.154936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:28.156152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-722fac56-99fa-4fba-b262-68930b9dd8f5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1730 microversion: 2.20 time: 0.174288 Sep 08 16:14:28.156716 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 446/853] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:27 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:29.182021 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:29.182799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:29.189969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:29.190474 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:29.190906 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:29.191627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:29.192079 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:29.192501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:29.327281 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:29.335796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:29.337241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:29.338420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-667dd9d4-af76-4e9d-8fdb-e386669bf83e tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1717 microversion: 2.20 time: 0.160422 Sep 08 16:14:29.338996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 408/854] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:14:29 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:14:29.652889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:29.653446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:29.660051 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:29.660408 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:29.660832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:29.661499 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:29.661939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:29.662354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:29.743837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lazy-loading 'services' on Instance uuid af7a000b-14e1-44c6-a9c7-6b485a91c350 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:14:29.817941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d6fef6d2-eb06-4177-8a56-259db3737bd0 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments/937cc065-ef96-44fe-b068-823db7a43208" status: 202 len: 0 microversion: 2.1 time: 0.168760 Sep 08 16:14:29.818906 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 447/855] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:14:29 2022] DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments/937cc065-ef96-44fe-b068-823db7a43208 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:14:29.826962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:29.829312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:29.835594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:29.836081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:29.836508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:29.837206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:29.837658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:29.838080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:29.868627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bbd6b6a2-20a4-4ce3-b6a5-1dd2f799e97b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045662 Sep 08 16:14:29.869461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 409/856] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:14:29 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:30.887253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:30.891002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:30.902557 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:30.903348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:30.904130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:30.905259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:30.906011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:30.906706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:30.936764 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e65faa97-d199-4fc5-ba5e-623aa67de7b5 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056675 Sep 08 16:14:30.937332 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 448/857] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:14:30 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:14:31.010494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:31.011047 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:31.017822 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:31.018301 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:31.018732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:31.019412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:31.019901 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:31.020316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:31.045612 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:14:31.127324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8bd6d9e7-8acb-4eeb-aa03-c95b31f54ba8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 204 len: 0 microversion: 2.1 time: 0.120308 Sep 08 16:14:31.127936 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 410/858] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:14:31 2022] DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:14:31.136668 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:31.137333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:31.143412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:31.143915 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:31.144342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:31.145014 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:31.145456 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:31.145864 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:31.279081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:31.287049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6fbe0777-9d89-4cb1-9224-8c5399ac491a tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1681 microversion: 2.1 time: 0.154273 Sep 08 16:14:31.287670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 449/859] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:31 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:32.315006 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:32.315739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:32.323348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:32.323861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:32.324293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:32.325004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:32.325455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:32.325878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:32.464540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:32.472889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ccb7753d-13f4-449b-b18a-1d6224297285 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1681 microversion: 2.1 time: 0.164669 Sep 08 16:14:32.473453 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 411/860] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:32 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:32.772439 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:32.773064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:32.779596 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:32.780090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:32.780524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:32.781243 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:32.781697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:32.782125 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:32.805785 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-48ca5d99-e389-4167-9903-0dcd068b3550 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/ips" status: 200 len: 144 microversion: 2.1 time: 0.209194 Sep 08 16:14:32.806343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 450/861] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:14:32 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/ips => generated 144 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:33.496728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:33.497407 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:33.505254 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:33.505736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:33.506159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:33.506851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:33.507295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:33.507797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:33.595707 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b673d5c65d40d9a90cc3b579e83e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91730a2601824af19a540c48681e6fc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:33.605912 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f31646e3-0d5f-4d7a-a58a-51b50ed87a7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 200 len: 1613 microversion: 2.1 time: 0.113069 Sep 08 16:14:33.606484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 412/862] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:33 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:14:33.785355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-e4bc7928-aabf-4c8c-b337-6d18290f2d7b req-aad334a6-4900-4701-8576-23d6c9d8c05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7a000b-14e1-44c6-a9c7-6b485a91c350", "name": "network-vif-deleted", "tag": "ea042f6a-f127-410f-8d28-d13b783df768"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:33.796176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e4bc7928-aabf-4c8c-b337-6d18290f2d7b req-aad334a6-4900-4701-8576-23d6c9d8c05f service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:33.796660 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e4bc7928-aabf-4c8c-b337-6d18290f2d7b req-aad334a6-4900-4701-8576-23d6c9d8c05f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:33.797092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-e4bc7928-aabf-4c8c-b337-6d18290f2d7b req-aad334a6-4900-4701-8576-23d6c9d8c05f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:33.809128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-e4bc7928-aabf-4c8c-b337-6d18290f2d7b req-aad334a6-4900-4701-8576-23d6c9d8c05f service nova] Creating event network-vif-deleted:ea042f6a-f127-410f-8d28-d13b783df768 for instance af7a000b-14e1-44c6-a9c7-6b485a91c350 on hv-cinder-85625 Sep 08 16:14:33.814871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-e4bc7928-aabf-4c8c-b337-6d18290f2d7b req-aad334a6-4900-4701-8576-23d6c9d8c05f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033229 Sep 08 16:14:33.815985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 451/863] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:34.176659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:34.179059 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:34.185370 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.186684 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.186684 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.187351 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.187833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.188260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.457319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:34.457947 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:34.465482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.465959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.466585 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.467298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.467945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.468451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.504421 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lazy-loading 'flavor' on Instance uuid d33ef9ec-1173-489a-a3cc-5c98fe9ee293 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:14:34.549570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-35b951b3-0008-4f2c-96b9-8e4c2bce47ec tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376383 Sep 08 16:14:34.550521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 413/864] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:14:34 2022] POST /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:34.615741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-34cd8dd0-a2e7-4bda-bd19-76e27b01aff7 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "POST /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293/action" status: 202 len: 0 microversion: 2.1 time: 0.158734 Sep 08 16:14:34.615741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 452/865] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:14:34 2022] POST /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 16:14:34.621673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:34.622284 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:34.635871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.636365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.636799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.637501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.637951 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.638414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.645168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:34.645351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:34.665517 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.666040 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.667625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.668350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:34.668802 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:34.669222 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:34.684201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 HTTP/1.1 Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:14:34.686420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:34.687905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'af7a000b-14e1-44c6-a9c7-6b485a91c350'} Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:34.688670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:34.689941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:34.691943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:34.691943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b61b8537-ad72-4f81-958c-ac8e84557b7f tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 404 len: 111 microversion: 2.1 time: 0.056862 Sep 08 16:14:34.691943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 453/866] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:34 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:14:34.697343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3494a04f-a425-4dd7-9a12-0c22e9e2b0c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '.version_select at 0x7f886010a3a0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:34.719629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3494a04f-a425-4dd7-9a12-0c22e9e2b0c1 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137853086" status: 202 len: 0 microversion: 2.1 time: 0.026057 Sep 08 16:14:34.720414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 454/867] 10.222.0.27 () {58 vars in 1218 bytes} [Thu Sep 8 16:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137853086 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:14:34.834000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:34.842143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-017645b0-a1e5-4ca3-8d6b-b07d7635c621 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.224645 Sep 08 16:14:34.842939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 414/868] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:34 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:35.884809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:35.885810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:35.896045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:35.896511 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:35.896940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:35.897658 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:35.898128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:35.898555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:36.039660 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:36.049524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-07c6eccc-47d3-4cc6-95f0-99723ad53fd6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.171737 Sep 08 16:14:36.050436 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 455/869] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:35 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:36.507937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:36.508455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:36.515229 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:36.515776 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:36.516206 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:36.516896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:36.517410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:36.517836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:36.531672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 HTTP/1.1 Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:14:36.533364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.534921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'af7a000b-14e1-44c6-a9c7-6b485a91c350'} Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:36.535802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.537247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.538637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:36.538637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-87c4f622-213b-4da6-9907-6f0d3463a858 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 404 len: 111 microversion: 2.1 time: 0.030728 Sep 08 16:14:36.538637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 415/870] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:14:36 2022] DELETE /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:36.543198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:36.543836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: af7a000b-14e1-44c6-a9c7-6b485a91c350] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:36.549818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:36.550393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:36.550818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:36.551518 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:36.551958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:36.552371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:36.566276 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 HTTP/1.1 Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:14:36.567838 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.569372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'af7a000b-14e1-44c6-a9c7-6b485a91c350'} Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:36.570185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. Sep 08 16:14:36.571612 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:36.573002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance af7a000b-14e1-44c6-a9c7-6b485a91c350 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:36.573002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-71e7e898-42ba-4658-a30c-1d19933dbe9d tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350" status: 404 len: 111 microversion: 2.1 time: 0.029854 Sep 08 16:14:36.573002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 456/871] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:36 2022] GET /compute/v2.1/servers/af7a000b-14e1-44c6-a9c7-6b485a91c350 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:37.082518 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:37.083537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:37.092478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.093137 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.093714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.094631 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.095241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.095859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.234260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:37.242451 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-19a71500-6807-47d6-8649-9fee867be328 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.166451 Sep 08 16:14:37.243017 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 416/872] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:37 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:37.726821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:37.727379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:37.733940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.734420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.734852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.735564 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.736011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.736435 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.749974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a HTTP/1.1 Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:14:37.751580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.753178 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '52645e54-6325-4fb6-a2d5-20a2331a135a'} Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:37.754728 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.756954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.758399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:37.758399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dee70a72-4185-41c1-9784-61fd36f7a4cc tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 404 len: 111 microversion: 2.1 time: 0.030783 Sep 08 16:14:37.758399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 457/873] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:14:37 2022] DELETE /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:37.763970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:37.764574 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 52645e54-6325-4fb6-a2d5-20a2331a135a] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:37.770596 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.771074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.771575 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.772263 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.772734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.773154 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.786813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a HTTP/1.1 Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:14:37.788406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.789851 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '52645e54-6325-4fb6-a2d5-20a2331a135a'} Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:37.790585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. Sep 08 16:14:37.791785 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.792865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 52645e54-6325-4fb6-a2d5-20a2331a135a could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:37.792865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-88e55932-b9a7-439a-8aa6-811935dacabb tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a" status: 404 len: 111 microversion: 2.1 time: 0.029917 Sep 08 16:14:37.792865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 417/874] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:37 2022] GET /compute/v2.1/servers/52645e54-6325-4fb6-a2d5-20a2331a135a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:37.798530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:37.799027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:37.805230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.805703 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.806126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.806803 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.807246 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.807690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.810313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:37.822818 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 HTTP/1.1 Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:14:37.824459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.826088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '23052556-fe21-4d01-936b-c88007a44203'} Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:37.827056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.828586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.830043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:37.830043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7fbcf814-33da-45b6-ba76-88944f86e120 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 404 len: 111 microversion: 2.1 time: 0.031244 Sep 08 16:14:37.830043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 458/875] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:14:37 2022] DELETE /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:37.834485 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:37.835107 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 23052556-fe21-4d01-936b-c88007a44203] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:37.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.841939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.842373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.843059 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:37.843544 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:37.843969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:37.857345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 HTTP/1.1 Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:14:37.858853 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.860356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '23052556-fe21-4d01-936b-c88007a44203'} Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:37.861396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. Sep 08 16:14:37.862835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:37.864246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 23052556-fe21-4d01-936b-c88007a44203 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:37.864246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-880f9839-244b-4a3a-a9b5-20c5e6d20fb8 tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203" status: 404 len: 111 microversion: 2.1 time: 0.029705 Sep 08 16:14:37.864246 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 418/876] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:37 2022] GET /compute/v2.1/servers/23052556-fe21-4d01-936b-c88007a44203 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:38.271161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:38.272077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:38.283528 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:38.284329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:38.285062 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:38.286220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:38.286981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:38.287745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:38.424816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:38.432933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-030d4227-e4b3-4927-89c1-a5bb2f5fa72a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.169492 Sep 08 16:14:38.433472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 459/877] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:38 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:39.018461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:39.019031 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:39.025933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:39.026423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:39.026859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:39.027586 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:39.028045 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:39.028472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:39.042351 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c HTTP/1.1 Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:14:39.044003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.045459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '85d36039-930c-4f96-93c3-c9fb893ae77c'} Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:39.046180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.047349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.048568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:39.048568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1a52053c-f057-4698-b953-b2ceaa3bcb5b tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 404 len: 111 microversion: 2.1 time: 0.030891 Sep 08 16:14:39.048568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 419/878] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:14:39 2022] DELETE /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:39.054177 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:39.054790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] [instance: 85d36039-930c-4f96-93c3-c9fb893ae77c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:39.057201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:39.063006 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:39.063485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:39.063950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:39.064638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:39.065090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:39.065513 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:39.080452 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] HTTP exception thrown: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Request method failure captured: Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c HTTP/1.1 Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNmfGOqZaXjGhRWxxzCUcOfq3r9vCGqY0Hhv3X-DpENKN8tjN52pYmYD0xV1Is-7AwG0EWxqRM_NSAg1kgp28Q3Vnl-UFXbTkLedwVhP8hPxdFYdke51OL8Y3FenoJP5FFoAMH6FqxUwwE5B0DM964Y3Orpt9zvm_GxQaeAOAU2H8I Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:14:39.081985 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/91730a2601824af19a540c48681e6fc3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_91730a2601824af19a540c48681e6fc3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/91730a2601824af19a540c48681e6fc3"}]}] Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 91730a2601824af19a540c48681e6fc3 Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706413093 Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 00b673d5c65d40d9a90cc3b579e83e7f Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeNegativeTest-706413093-project Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.083708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '85d36039-930c-4f96-93c3-c9fb893ae77c'} Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:14:39.084667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. Sep 08 16:14:39.086146 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:14:39.087501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] Returning 404 to user: Instance 85d36039-930c-4f96-93c3-c9fb893ae77c could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:14:39.087501 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2b0cb8f5-2475-41f4-b398-bd8b2b0bb8ba tempest-AttachVolumeNegativeTest-706413093 tempest-AttachVolumeNegativeTest-706413093-project] 10.222.0.27 "GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c" status: 404 len: 111 microversion: 2.1 time: 0.033120 Sep 08 16:14:39.087672 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 460/879] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:39 2022] GET /compute/v2.1/servers/85d36039-930c-4f96-93c3-c9fb893ae77c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:14:39.456963 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:39.457655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:39.464470 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:39.464966 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:39.465457 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:39.466146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:39.466606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:39.467030 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:39.605534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:39.613761 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fa5c85ed-5520-451a-b5e8-aebccc3ff774 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.160833 Sep 08 16:14:39.614346 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 420/880] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:39 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:40.637303 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:40.637844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:40.644308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:40.644761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:40.645200 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:40.645885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:40.646329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:40.646745 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:40.853826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:40.873539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9af503c3-af44-4d58-83b8-7c616a85804a tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.240306 Sep 08 16:14:40.874525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 461/881] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:40 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:41.061874 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:41.064205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:41.070903 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:41.071387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:41.071854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:41.072542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:41.073100 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:41.073519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:41.108975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4fd9a245-fb71-45bc-ab91-4dc3a7676478 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051562 Sep 08 16:14:41.109724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 421/882] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:14:41 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:41.121760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:41.122263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:41.128218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:41.128707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:41.129133 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:41.130075 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:41.130591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:41.131081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:41.160688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-68ef4761-a0ac-4067-8a8b-046a07cbc7b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7" status: 200 len: 194 microversion: 2.1 time: 0.044224 Sep 08 16:14:41.161666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 462/883] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 8 16:14:41 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:41.900240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:41.901323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:41.907690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:41.908484 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:41.908810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:41.909512 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:41.910076 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:41.910364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:41.935545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:42.098772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:42.106979 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-db09ca1b-02bc-4474-a252-ccfac010b27f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.210739 Sep 08 16:14:42.107672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 422/884] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:41 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:42.599026 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95ad2f25-7e72-4d6e-894a-5bc1b096c2ff"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:42.601551 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:42.608638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:42.609130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:42.609574 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:42.610368 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:42.610825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:42.615856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:42.912732 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-53fbc7c5-164b-4941-aec9-40e3efb3b642 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "POST /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317674 Sep 08 16:14:42.913716 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 463/885] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:14:42 2022] POST /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:43.130209 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:43.131379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:43.138396 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:43.138972 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:43.139472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:43.140218 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:43.140875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:43.141516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:43.284186 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:43.292302 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f76c21d5-b9e3-4c77-9740-66a6a3d9832e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.165877 Sep 08 16:14:43.293109 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 423/886] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:43 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:44.316973 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:44.317684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:44.324059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:44.324535 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:44.324959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:44.325637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:44.326077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:44.326495 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:44.461126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:44.469765 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-402292c5-b2ef-4d7c-8105-8ffecac3dfd4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.157463 Sep 08 16:14:44.470362 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 464/887] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:44 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:45.497502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:45.498111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:45.509391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:45.509882 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:45.510541 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:45.511249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:45.511885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:45.512310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:45.722801 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:45.730877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c5892ce1-7263-4c6f-98e2-d0ff504c1a58 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.241671 Sep 08 16:14:45.731736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 424/888] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:45 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:46.754600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:46.755286 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:46.762809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:46.763312 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:46.763773 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:46.764488 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:46.765138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:46.765560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:46.900064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:46.907856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-64bc2deb-eefe-4b8f-beae-cac23d13758c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.157249 Sep 08 16:14:46.908419 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 465/889] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:46 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:47.930967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:47.931655 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:47.938865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:47.939338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:47.939797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:47.940475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:47.940921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:47.941336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:48.079013 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:48.086882 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-328d3c1f-235e-4fc7-a7d8-a46a94e6a5a9 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1569 microversion: 2.1 time: 0.159932 Sep 08 16:14:48.087429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 425/890] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:47 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:48.109650 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:48.110249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:48.116836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:48.117594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:48.118045 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:48.118763 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:48.119290 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:48.119756 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:48.148561 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120783) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 16:14:48.219958 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dd56b0ae-14eb-40c9-9bfd-b5cc481a6b2e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "POST /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293/action" status: 202 len: 0 microversion: 2.1 time: 0.114195 Sep 08 16:14:48.220609 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 466/891] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:14:48 2022] POST /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:14:48.232253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:48.232606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:48.240506 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:48.241155 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:48.241961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:48.243080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:48.243815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:48.244701 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:48.387389 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:48.395356 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eed9392e-c326-4db3-a019-f8fb5392ffba tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1517 microversion: 2.1 time: 0.169921 Sep 08 16:14:48.395932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 426/892] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:48 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:49.423583 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:49.424578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:49.434964 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:49.436170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:49.437021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:49.438041 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:49.438787 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:49.439505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:49.589007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:49.597185 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-28063126-82cb-4b3f-a2cc-18e5e3cf0441 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1517 microversion: 2.1 time: 0.181126 Sep 08 16:14:49.597768 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 467/893] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:49 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:50.623899 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:50.624863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:50.636699 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:50.637483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:50.638227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:50.639430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:50.640231 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:50.640963 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:50.776004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:50.784105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c37dee1a-0246-440d-9d2a-70881ffdd742 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1517 microversion: 2.1 time: 0.166800 Sep 08 16:14:50.784705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 427/894] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:50 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:51.808152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:51.808777 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:51.816363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:51.816855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:51.817285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:51.817984 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:51.818614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:51.819247 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:51.928494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-add31956-62dd-4f35-b841-c5f3e93b4789 req-643ea86e-2118-4950-998a-5f6be66b6673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "name": "network-vif-unplugged", "status": "completed", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:14:51.939759 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-add31956-62dd-4f35-b841-c5f3e93b4789 req-643ea86e-2118-4950-998a-5f6be66b6673 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:51.940398 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-add31956-62dd-4f35-b841-c5f3e93b4789 req-643ea86e-2118-4950-998a-5f6be66b6673 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:51.940914 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-add31956-62dd-4f35-b841-c5f3e93b4789 req-643ea86e-2118-4950-998a-5f6be66b6673 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:51.953769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.compute.server_external_events [req-add31956-62dd-4f35-b841-c5f3e93b4789 req-643ea86e-2118-4950-998a-5f6be66b6673 service nova] Unable to find a host for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293. Dropping event network-vif-unplugged {{(pid=120782) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 16:14:51.954924 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-add31956-62dd-4f35-b841-c5f3e93b4789 req-643ea86e-2118-4950-998a-5f6be66b6673 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031226 Sep 08 16:14:51.956022 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 428/895] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 08 16:14:51.974198 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:51.984215 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-eb440a5e-5a4e-417a-98ca-efaf891b2381 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1519 microversion: 2.1 time: 0.180015 Sep 08 16:14:51.984917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 468/896] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:51 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:52.628953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:52.631141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:52.637386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:52.637863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:52.638313 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:52.638997 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:52.639482 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:52.639896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:52.669844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-eb2b8b84-f35d-44c1-8c30-2bee01f6d6b8 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044910 Sep 08 16:14:52.670380 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 429/897] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:14:52 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:52.860403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:52.861320 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:52.871208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:52.871734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:52.872169 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:52.872854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:52.873313 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:52.873766 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:52.902902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-45f8fc68-ea26-41f5-8d7b-1cddf9a79104 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7" status: 200 len: 194 microversion: 2.1 time: 0.049373 Sep 08 16:14:52.903473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 469/898] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 8 16:14:52 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:52.914237 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:52.914724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:52.920998 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:52.921477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:52.921930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:52.922622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:52.923074 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:52.923490 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:53.008485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:53.009123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:53.009276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lazy-loading 'services' on Instance uuid 6cbb14de-4ea7-471b-8a67-ea775d53954b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:14:53.015314 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:53.015826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:53.016253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:53.016947 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:53.017446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:53.017842 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:53.090153 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f22d0b7c-5f27-463a-acb1-15a555090b0a tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7" status: 202 len: 0 microversion: 2.1 time: 0.179682 Sep 08 16:14:53.091011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 430/899] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:14:52 2022] DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/0f5b6e4c-89e2-4452-9a7d-c86d7369e5c7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:14:53.155825 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:53.163746 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-eed61b03-924c-40dd-8973-baeb72ba7bcb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.159586 Sep 08 16:14:53.164320 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 470/900] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:53 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:54.189772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:54.190471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:54.192943 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:54.199119 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:54.199641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:54.200072 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:54.200764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:54.201214 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:54.201636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:54.342182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:54.350924 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-aceb3b26-fbe4-49df-8b72-2409475f3eeb tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.166198 Sep 08 16:14:54.351695 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 431/901] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:54 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:55.378665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:55.380219 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:55.389920 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:55.390409 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:55.390830 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:55.391580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:55.392038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:55.392673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:55.544296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:55.552871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-942f4de0-39b0-47ac-9cfe-904a48f9e4b8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.181250 Sep 08 16:14:55.553455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 471/902] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:55 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:56.577042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:56.577647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:56.584471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:56.584955 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:56.585385 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:56.586077 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:56.586528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:56.586950 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:56.725144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:56.734082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7e8e6d73-dff0-4564-9dbb-79f425a53978 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.161051 Sep 08 16:14:56.734642 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 432/903] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:56 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:57.415629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:57.416152 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:57.422983 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:57.423487 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:57.423923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:57.424613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:57.425066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:57.425492 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:57.454678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8de298f7-2963-44e9-977e-4ae3114ffc81 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/95ad2f25-7e72-4d6e-894a-5bc1b096c2ff" status: 200 len: 194 microversion: 2.1 time: 0.043015 Sep 08 16:14:57.455172 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 472/904] 10.222.0.27 () {58 vars in 1413 bytes} [Thu Sep 8 16:14:57 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/95ad2f25-7e72-4d6e-894a-5bc1b096c2ff => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:14:57.471118 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:57.471735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:57.480345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:57.480994 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:57.481573 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:57.482374 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:57.482820 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:57.483236 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:57.573877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lazy-loading 'services' on Instance uuid 6cbb14de-4ea7-471b-8a67-ea775d53954b {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:14:57.650159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-de2b81ba-e824-4c8e-851b-ab068b5ccf71 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/95ad2f25-7e72-4d6e-894a-5bc1b096c2ff" status: 202 len: 0 microversion: 2.1 time: 0.184978 Sep 08 16:14:57.650811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 433/905] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:14:57 2022] DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments/95ad2f25-7e72-4d6e-894a-5bc1b096c2ff => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:14:57.757496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:57.758028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:57.764522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:57.765007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:57.765437 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:57.766127 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:57.766580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:57.767004 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:57.910366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:57.912781 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:14:57.919754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-44e9a405-8497-43a3-b152-5746d6ca52cd tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.166277 Sep 08 16:14:57.920347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 473/906] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:57 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:14:58.943809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:14:58.944508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:14:58.953111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:58.953594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:58.954024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:58.954709 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:14:58.955162 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:14:58.955608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:14:59.088405 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:14:59.100646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b93b29f1-9220-4423-b1df-65a7df3c36a0 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.161133 Sep 08 16:14:59.101452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 434/907] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:14:58 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:00.125566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:00.126257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:00.134657 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:00.135175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:00.135691 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:00.136388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:00.136817 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:00.137262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:00.275212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:00.283796 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dce21d57-decd-4ad4-9a30-dafb925836d3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.162133 Sep 08 16:15:00.284459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 474/908] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:00 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:00.966724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:00.969185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:00.976433 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:00.976928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:00.977365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:00.978067 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:00.978527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:00.978953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.010125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cc8c0eda-9b8d-4cb8-90b3-6d70b140bced tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047384 Sep 08 16:15:01.010684 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 435/909] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:15:00 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:15:01.141190 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:01.143480 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:01.149931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.150427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.150865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.151587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.152041 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.152469 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.187889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ffc3fdb5-71f0-42c2-affa-2442a991728d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050807 Sep 08 16:15:01.188480 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 475/910] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:15:01 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:15:01.254589 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:01.255093 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:01.260952 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.261438 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.261990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.262542 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.262999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.263529 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.288988 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:15:01.307809 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:01.308979 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:01.316138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.316843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.317457 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.318371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.319041 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.319667 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.345804 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:01.385561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b58ee4fd-8018-49c0-aed1-043ada7d807d tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 204 len: 0 microversion: 2.1 time: 0.132493 Sep 08 16:15:01.386941 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 436/911] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:15:01 2022] DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:15:01.398871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:01.401541 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:01.412780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.413494 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.413717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.414391 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:01.414842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:01.415265 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:01.476735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:01.484927 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9d72081c-9809-4f52-815b-cdb2acec83c6 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.181077 Sep 08 16:15:01.485499 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 476/912] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:01 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:01.559277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:01.567570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e3f59a4-0fba-40d0-9ba7-8ad8f3a13ede tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1673 microversion: 2.1 time: 0.174740 Sep 08 16:15:01.568112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 437/913] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:01 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:02.508298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:02.508881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:02.516604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:02.517090 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:02.517519 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:02.518211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:02.518663 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:02.519087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:02.590652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:02.591229 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:02.597642 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:02.598146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:02.598558 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:02.599247 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:02.599730 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:02.600150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:02.653289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:02.661496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-abda51c7-f606-4663-a6f4-c74631d2e33d tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.157124 Sep 08 16:15:02.662080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 477/914] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:02 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:02.733402 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:02.741537 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9512e0da-cce9-4fea-a345-1dc191979186 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1673 microversion: 2.1 time: 0.155015 Sep 08 16:15:02.742118 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 438/915] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:02 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:03.689230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:03.690217 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:03.701363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:03.701845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:03.702275 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:03.702954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:03.703401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:03.703919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:03.767420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:03.768922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:03.775472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:03.775986 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:03.779412 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:03.780150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:03.780606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:03.781027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:03.843698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:03.851573 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5e57b8e8-88fe-4c64-9c08-a40b3c2e7de5 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.169249 Sep 08 16:15:03.852186 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 478/916] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:03 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:03.917938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:03.926159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-37532868-ebbe-4cee-8985-fbd7157c2a74 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1673 microversion: 2.1 time: 0.165018 Sep 08 16:15:03.926739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 439/917] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:03 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:04.878538 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:04.879505 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:04.889866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:04.890342 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:04.890770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:04.891486 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:04.891931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:04.892347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:04.954248 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:04.954933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:04.961815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:04.962384 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:04.962893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:04.963762 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:04.964296 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:04.964732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:05.034145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:05.041837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fa99d912-d71a-46ba-9cc6-daada4510b7f tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.170040 Sep 08 16:15:05.042411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 479/918] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:04 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:05.100143 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:05.108228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-edcfe9f3-4ab3-48a6-a2c6-cb5ca5245748 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1673 microversion: 2.1 time: 0.159021 Sep 08 16:15:05.108815 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 440/919] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:04 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:06.065739 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:06.066335 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:06.073876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:06.074358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:06.074810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:06.075557 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:06.076020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:06.076445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:06.140288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:06.141570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:06.148715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:06.149595 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:06.150193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:06.151090 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:06.151771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:06.152401 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:06.233742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:06.242876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3794455d-5150-409d-a14b-abdee811066e tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.180996 Sep 08 16:15:06.243832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 480/920] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:06 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:06.261637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965cbbdb06c248698ef54527c29767df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67853e0ad324ac595650e59f9a90f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:06.273457 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-c0d07879-b93c-4da7-92b2-4255fc16dd5c req-98e15d8c-0415-4b4c-bc70-2cab5dbd8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbb14de-4ea7-471b-8a67-ea775d53954b", "name": "network-vif-deleted", "tag": "42120762-d5ef-4d2e-950e-e28a2a6cfca5"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:06.280966 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9d3898f5-f2ed-4e2c-96df-676b2c1007a1 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 200 len: 1605 microversion: 2.1 time: 0.144629 Sep 08 16:15:06.282129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 441/921] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:06 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 1605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:15:06.283715 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c0d07879-b93c-4da7-92b2-4255fc16dd5c req-98e15d8c-0415-4b4c-bc70-2cab5dbd8c55 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:06.284269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c0d07879-b93c-4da7-92b2-4255fc16dd5c req-98e15d8c-0415-4b4c-bc70-2cab5dbd8c55 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:06.284859 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-c0d07879-b93c-4da7-92b2-4255fc16dd5c req-98e15d8c-0415-4b4c-bc70-2cab5dbd8c55 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:06.296187 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-c0d07879-b93c-4da7-92b2-4255fc16dd5c req-98e15d8c-0415-4b4c-bc70-2cab5dbd8c55 service nova] Creating event network-vif-deleted:42120762-d5ef-4d2e-950e-e28a2a6cfca5 for instance 6cbb14de-4ea7-471b-8a67-ea775d53954b on hv-cinder-85625 Sep 08 16:15:06.301852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-c0d07879-b93c-4da7-92b2-4255fc16dd5c req-98e15d8c-0415-4b4c-bc70-2cab5dbd8c55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Sep 08 16:15:06.303555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 481/922] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:15:07.266567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:07.267212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:07.274517 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:07.275101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:07.275683 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:07.276714 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:07.277285 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:07.277827 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:07.306552 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:07.307232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:07.314566 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:07.315351 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:07.315850 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:07.316542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:07.317038 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:07.317400 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:07.331760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] HTTP exception thrown: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Request method failure captured: Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b HTTP/1.1 Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhOyZ0uvcTkL6ym7fkOSTVvc-dBpniz-LDYuFMD9mcSfxOXd6gW8GDkWed1qjsiD_ry9voB6tJwFiqnLB83jduTgcbD9T_q2lQn4qKdFVOQo9xBt8zTNicgO1hftGCQbR5vIX5-J4wfK-2QuXmY1HoOwS8wdFIcVSOPABqhc7-2Cksc Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:15:07.333445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67853e0ad324ac595650e59f9a90f56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}] Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 965cbbdb06c248698ef54527c29767df Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:07.334848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '6cbb14de-4ea7-471b-8a67-ea775d53954b'} Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:07.336431 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:07.338350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:07.340541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Returning 404 to user: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:07.340541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b915513b-5cc1-4176-ba11-b3929197b702 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 404 len: 111 microversion: 2.1 time: 0.033014 Sep 08 16:15:07.340541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 482/923] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:07 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:15:07.344371 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f294844-e3e3-4400-8143-541799e06ba2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '.version_select at 0x7f885bfc39d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:07.363514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2f294844-e3e3-4400-8143-541799e06ba2 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245423295" status: 202 len: 0 microversion: 2.1 time: 0.023135 Sep 08 16:15:07.364095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 483/924] 10.222.0.27 () {58 vars in 1221 bytes} [Thu Sep 8 16:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245423295 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:15:07.425110 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:07.432874 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-397291fd-85b8-4d5e-933e-7ee769c6d158 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.171242 Sep 08 16:15:07.433458 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 442/925] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:07 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:08.374028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-3b0309d3-4dfb-4186-8d77-51f003b775ee req-909bc99e-e457-4ce8-9b65-a7047a91d42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "name": "network-vif-plugged", "status": "completed", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:08.384935 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-3b0309d3-4dfb-4186-8d77-51f003b775ee req-909bc99e-e457-4ce8-9b65-a7047a91d42f service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:08.385411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-3b0309d3-4dfb-4186-8d77-51f003b775ee req-909bc99e-e457-4ce8-9b65-a7047a91d42f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:08.385871 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-3b0309d3-4dfb-4186-8d77-51f003b775ee req-909bc99e-e457-4ce8-9b65-a7047a91d42f service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:08.396386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-3b0309d3-4dfb-4186-8d77-51f003b775ee req-909bc99e-e457-4ce8-9b65-a7047a91d42f service nova] Creating event network-vif-plugged:ad971a2b-7909-43cc-ae5d-c8907276f5de for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 on hv-cinder-85625 Sep 08 16:15:08.401306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-3b0309d3-4dfb-4186-8d77-51f003b775ee req-909bc99e-e457-4ce8-9b65-a7047a91d42f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 Sep 08 16:15:08.402106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 484/926] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:08.456812 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:08.457580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:08.464892 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:08.465377 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:08.465814 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:08.466507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:08.467011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:08.467433 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:08.613252 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:08.621347 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-34b20247-451e-43e2-94d3-742c59de084b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.168529 Sep 08 16:15:08.621926 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 443/927] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:08 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:09.644959 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:09.645652 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:09.647747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:09.653032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:09.653513 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:09.654047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:09.654632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:09.655081 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:09.655634 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:09.795572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:09.803544 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-434545db-869f-4854-a98e-9a1bbf6cc815 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.163522 Sep 08 16:15:09.804118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 485/928] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:09 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:10.826423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:10.827028 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:10.833567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:10.834047 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:10.834472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:10.835150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:10.835622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:10.836034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:10.966210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:10.974401 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-556587ed-9b7d-49aa-b97a-9cc85c0c8378 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.151974 Sep 08 16:15:10.974977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 444/929] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:10 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:11.998491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:11.999857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:12.006982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:12.007495 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:12.007931 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:12.008640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:12.009092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:12.009514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:12.145633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:12.153632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ad0486f8-633d-4b16-adba-6aa4372c247b tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1575 microversion: 2.1 time: 0.160092 Sep 08 16:15:12.154176 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 486/930] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:11 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:12.391259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:12.391831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:12.398398 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:12.398889 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:12.399387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:12.400107 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:12.400561 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:12.400976 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:12.415144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] HTTP exception thrown: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Request method failure captured: Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b HTTP/1.1 Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhOyZ0uvcTkL6ym7fkOSTVvc-dBpniz-LDYuFMD9mcSfxOXd6gW8GDkWed1qjsiD_ry9voB6tJwFiqnLB83jduTgcbD9T_q2lQn4qKdFVOQo9xBt8zTNicgO1hftGCQbR5vIX5-J4wfK-2QuXmY1HoOwS8wdFIcVSOPABqhc7-2Cksc Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:15:12.416852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67853e0ad324ac595650e59f9a90f56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}] Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 965cbbdb06c248698ef54527c29767df Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.418181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '6cbb14de-4ea7-471b-8a67-ea775d53954b'} Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:12.419303 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.420609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.421825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Returning 404 to user: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:12.421825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-528f35ae-9a75-4240-9414-2cf4d8952124 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 404 len: 111 microversion: 2.1 time: 0.031003 Sep 08 16:15:12.421825 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 445/931] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:15:12 2022] DELETE /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:12.427280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:12.428064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 6cbb14de-4ea7-471b-8a67-ea775d53954b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:12.434122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:12.434603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:12.435385 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:12.436103 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:12.436549 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:12.436965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:12.450805 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] HTTP exception thrown: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Request method failure captured: Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b HTTP/1.1 Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhOyZ0uvcTkL6ym7fkOSTVvc-dBpniz-LDYuFMD9mcSfxOXd6gW8GDkWed1qjsiD_ry9voB6tJwFiqnLB83jduTgcbD9T_q2lQn4qKdFVOQo9xBt8zTNicgO1hftGCQbR5vIX5-J4wfK-2QuXmY1HoOwS8wdFIcVSOPABqhc7-2Cksc Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:15:12.452560 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67853e0ad324ac595650e59f9a90f56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}] Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 965cbbdb06c248698ef54527c29767df Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.454202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '6cbb14de-4ea7-471b-8a67-ea775d53954b'} Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:12.455327 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. Sep 08 16:15:12.456815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:12.458253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Returning 404 to user: Instance 6cbb14de-4ea7-471b-8a67-ea775d53954b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:12.458253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-98a2a9f5-6e7f-440a-a797-f5f70744540c tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b" status: 404 len: 111 microversion: 2.1 time: 0.030761 Sep 08 16:15:12.458253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 487/932] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:12 2022] GET /compute/v2.1/servers/6cbb14de-4ea7-471b-8a67-ea775d53954b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:13.181048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:13.182096 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:13.192743 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:13.193541 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:13.194238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:13.195421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:13.196185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:13.196885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:13.333411 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:13.345125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-768a431b-1676-44bb-b870-b4eb62ab4a30 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1562 microversion: 2.1 time: 0.170323 Sep 08 16:15:13.345940 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 446/933] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:13 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:13.608279 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:13.608791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:13.615913 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:13.616402 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:13.616856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:13.617529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:13.617976 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:13.618399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:13.632262 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] HTTP exception thrown: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Request method failure captured: Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b HTTP/1.1 Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhOyZ0uvcTkL6ym7fkOSTVvc-dBpniz-LDYuFMD9mcSfxOXd6gW8GDkWed1qjsiD_ry9voB6tJwFiqnLB83jduTgcbD9T_q2lQn4qKdFVOQo9xBt8zTNicgO1hftGCQbR5vIX5-J4wfK-2QuXmY1HoOwS8wdFIcVSOPABqhc7-2Cksc Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:15:13.633795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67853e0ad324ac595650e59f9a90f56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}] Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 965cbbdb06c248698ef54527c29767df Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.635280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '3328192d-87f0-46fe-97e1-57559cb1318b'} Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:13.636104 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.637349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.638586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Returning 404 to user: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:13.638586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e5d9399c-c519-462f-a725-4546c9d6ebc0 tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 404 len: 111 microversion: 2.1 time: 0.030845 Sep 08 16:15:13.638586 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 488/934] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:15:13 2022] DELETE /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:13.644140 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:13.644747 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] [instance: 3328192d-87f0-46fe-97e1-57559cb1318b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:13.651751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:13.652232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:13.652661 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:13.653368 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:13.653819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:13.654242 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:13.667752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] HTTP exception thrown: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Request method failure captured: Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b HTTP/1.1 Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhOyZ0uvcTkL6ym7fkOSTVvc-dBpniz-LDYuFMD9mcSfxOXd6gW8GDkWed1qjsiD_ry9voB6tJwFiqnLB83jduTgcbD9T_q2lQn4qKdFVOQo9xBt8zTNicgO1hftGCQbR5vIX5-J4wfK-2QuXmY1HoOwS8wdFIcVSOPABqhc7-2Cksc Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:15:13.669317 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67853e0ad324ac595650e59f9a90f56", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67853e0ad324ac595650e59f9a90f56"}]}] Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: c67853e0ad324ac595650e59f9a90f56 Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1985397 Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 965cbbdb06c248698ef54527c29767df Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeTestJSON-1985397-project Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.671336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '3328192d-87f0-46fe-97e1-57559cb1318b'} Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:13.672650 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. Sep 08 16:15:13.673823 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:13.674970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] Returning 404 to user: Instance 3328192d-87f0-46fe-97e1-57559cb1318b could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:13.674970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5ee6f72d-4502-4fef-8918-325371e8116f tempest-AttachVolumeTestJSON-1985397 tempest-AttachVolumeTestJSON-1985397-project] 10.222.0.27 "GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b" status: 404 len: 111 microversion: 2.1 time: 0.030436 Sep 08 16:15:13.674970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 447/935] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:15:13 2022] GET /compute/v2.1/servers/3328192d-87f0-46fe-97e1-57559cb1318b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:17.381482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:17.385420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:17.394255 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:17.395430 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:17.395988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:17.396997 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:17.397559 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:17.398134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:17.436514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f87a74ca-be85-43a0-9b21-17ea8a31f0c7 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060685 Sep 08 16:15:17.437967 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 489/936] 10.222.0.27 () {60 vars in 1343 bytes} [Thu Sep 8 16:15:17 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:17.508863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:17.510810 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:17.518658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:17.519414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:17.520099 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:17.520991 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:17.521605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:17.522249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:17.554400 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:15:17.663718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2a615e1b-f00f-4999-9bb0-b46860fd2fe8 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 204 len: 0 microversion: 2.20 time: 0.158408 Sep 08 16:15:17.664641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 448/937] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 16:15:17 2022] DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:15:17.673836 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:17.674697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:17.681622 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:17.682334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:17.682993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:17.683754 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:17.684234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:17.684681 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:17.841843 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:17.852155 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:17.853721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:17.854988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-63f4fff2-7ebd-4860-b338-4cd3f9f387eb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.185364 Sep 08 16:15:17.855679 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 490/938] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:15:17 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:15:18.882287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:18.883184 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:18.889603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:18.890084 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:18.890507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:18.891200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:18.891670 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:18.892251 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:19.121137 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:19.132569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:19.134354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:19.136394 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3709cf97-488b-4433-a646-a6775f4ddcc3 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1723 microversion: 2.20 time: 0.258835 Sep 08 16:15:19.137268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 449/939] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:15:18 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 16:15:20.164066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:20.164632 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:20.171380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:20.171905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:20.172345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:20.173093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:20.173568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:20.173994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:20.241824 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-25960ad9-41b1-4ce7-b0f0-9362e9bd9a38 req-adf3b0b1-0426-4ffc-83a5-fa0a00714347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0f7a3e-b44d-42b3-95e7-ca7f127eb362", "name": "network-vif-deleted", "tag": "ad594cf0-cd02-4c52-adfb-0646e4ecb42b"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:20.253082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-25960ad9-41b1-4ce7-b0f0-9362e9bd9a38 req-adf3b0b1-0426-4ffc-83a5-fa0a00714347 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:20.254042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-25960ad9-41b1-4ce7-b0f0-9362e9bd9a38 req-adf3b0b1-0426-4ffc-83a5-fa0a00714347 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:20.254475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-25960ad9-41b1-4ce7-b0f0-9362e9bd9a38 req-adf3b0b1-0426-4ffc-83a5-fa0a00714347 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:20.267431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-25960ad9-41b1-4ce7-b0f0-9362e9bd9a38 req-adf3b0b1-0426-4ffc-83a5-fa0a00714347 service nova] Creating event network-vif-deleted:ad594cf0-cd02-4c52-adfb-0646e4ecb42b for instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 on hv-cinder-85625 Sep 08 16:15:20.269608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:20.273240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-25960ad9-41b1-4ce7-b0f0-9362e9bd9a38 req-adf3b0b1-0426-4ffc-83a5-fa0a00714347 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034972 Sep 08 16:15:20.274350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 450/940] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:15:20.282914 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:20.284498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c89859a30a2442b8ae13fe0444782d9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52651960a8b6494193c5e8abc658a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:15:20.285730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5b81778d-6367-4f9e-9456-61110f6c34bb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 200 len: 1655 microversion: 2.20 time: 0.126476 Sep 08 16:15:20.286300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 491/941] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:15:20 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 1655 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 16:15:21.313652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:21.314392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:21.321282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:21.321765 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:21.322201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:21.322894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:21.323345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:21.323869 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:21.339043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] HTTP exception thrown: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Request method failure captured: Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 HTTP/1.1 Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNpVgXeu6Hgj34BnSjOSx6x1osSqTLRE1H6klSUD-31cfL0IajPuaKuh5aX_pQ-smt5IyUApsvkFI6LSbS9rWzC7GqsZyJENgki9uoPz9TRlf1suS8WUJEb9knqTqSvTQ77mCD9MhM2vNxSkFSYJB0xgwaLf3Pi5CEz6Q52h3qOFAo Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:15:21.340715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52651960a8b6494193c5e8abc658a2dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}] Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: c89859a30a2442b8ae13fe0444782d9c Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:21.342467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '3d0f7a3e-b44d-42b3-95e7-ca7f127eb362'} Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:21.343408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:21.345129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:21.346420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Returning 404 to user: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:21.346420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f79222e6-cb4c-40c5-8b9b-d2932a519522 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 404 len: 111 microversion: 2.20 time: 0.033370 Sep 08 16:15:21.346420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 451/942] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:15:21 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:21.352053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-05798cba-1dca-4064-8d9f-bb8460c9198f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '.version_select at 0x7f885bfee940>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:21.379831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-05798cba-1dca-4064-8d9f-bb8460c9198f tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806062703" status: 204 len: 0 microversion: 2.20 time: 0.032323 Sep 08 16:15:21.380445 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 492/943] 10.222.0.27 () {60 vars in 1259 bytes} [Thu Sep 8 16:15:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806062703 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 16:15:23.473842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:23.474333 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:23.481044 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:23.481533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:23.481967 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:23.482653 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:23.483104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:23.483563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:23.497198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] HTTP exception thrown: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Request method failure captured: Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 HTTP/1.1 Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNpVgXeu6Hgj34BnSjOSx6x1osSqTLRE1H6klSUD-31cfL0IajPuaKuh5aX_pQ-smt5IyUApsvkFI6LSbS9rWzC7GqsZyJENgki9uoPz9TRlf1suS8WUJEb9knqTqSvTQ77mCD9MhM2vNxSkFSYJB0xgwaLf3Pi5CEz6Q52h3qOFAo Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:15:23.498806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52651960a8b6494193c5e8abc658a2dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}] Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: c89859a30a2442b8ae13fe0444782d9c Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.500566 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '3d0f7a3e-b44d-42b3-95e7-ca7f127eb362'} Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:23.501651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.503157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.504773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Returning 404 to user: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:23.504773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-e8d1890d-f37b-4cb7-8074-517734b374b2 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 404 len: 111 microversion: 2.20 time: 0.030334 Sep 08 16:15:23.504773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 452/944] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 16:15:23 2022] DELETE /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:23.509226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:23.509837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:23.516872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:23.517356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:23.517823 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:23.518510 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:23.518960 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:23.519382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:23.532679 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] HTTP exception thrown: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Request method failure captured: Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 HTTP/1.1 Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNpVgXeu6Hgj34BnSjOSx6x1osSqTLRE1H6klSUD-31cfL0IajPuaKuh5aX_pQ-smt5IyUApsvkFI6LSbS9rWzC7GqsZyJENgki9uoPz9TRlf1suS8WUJEb9knqTqSvTQ77mCD9MhM2vNxSkFSYJB0xgwaLf3Pi5CEz6Q52h3qOFAo Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:15:23.534203 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52651960a8b6494193c5e8abc658a2dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}] Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: c89859a30a2442b8ae13fe0444782d9c Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.535834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '3d0f7a3e-b44d-42b3-95e7-ca7f127eb362'} Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:23.536869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. Sep 08 16:15:23.538363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:23.539826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Returning 404 to user: Instance 3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:23.539826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7051f66a-5703-4464-b1e7-bd7c9247b648 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362" status: 404 len: 111 microversion: 2.20 time: 0.030797 Sep 08 16:15:23.539826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 493/945] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:15:23 2022] GET /compute/v2.1/servers/3d0f7a3e-b44d-42b3-95e7-ca7f127eb362 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:26.810088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:26.810557 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:26.813065 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:26.818568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:26.819056 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:26.819491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:26.820214 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:26.820674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:26.821083 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:26.835868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] HTTP exception thrown: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Request method failure captured: Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c HTTP/1.1 Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhNpVgXeu6Hgj34BnSjOSx6x1osSqTLRE1H6klSUD-31cfL0IajPuaKuh5aX_pQ-smt5IyUApsvkFI6LSbS9rWzC7GqsZyJENgki9uoPz9TRlf1suS8WUJEb9knqTqSvTQ77mCD9MhM2vNxSkFSYJB0xgwaLf3Pi5CEz6Q52h3qOFAo Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:15:26.837428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52651960a8b6494193c5e8abc658a2dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}] Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: c89859a30a2442b8ae13fe0444782d9c Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.839146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'b86196fd-45b1-4137-abe6-0dcea457440c'} Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:26.840039 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.841450 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.842855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Returning 404 to user: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:26.842855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3eba9a68-1c92-476c-8116-732d5fd80fc5 tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 404 len: 111 microversion: 2.20 time: 0.033113 Sep 08 16:15:26.842855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 453/946] 10.222.0.27 () {60 vars in 1280 bytes} [Thu Sep 8 16:15:26 2022] DELETE /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:26.847762 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:26.848389 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] [instance: b86196fd-45b1-4137-abe6-0dcea457440c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:15:26.855016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:26.855517 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:26.855950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:26.856646 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:15:26.857089 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:15:26.857622 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:15:26.873263 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] HTTP exception thrown: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Request method failure captured: Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c HTTP/1.1 Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhNpVgXeu6Hgj34BnSjOSx6x1osSqTLRE1H6klSUD-31cfL0IajPuaKuh5aX_pQ-smt5IyUApsvkFI6LSbS9rWzC7GqsZyJENgki9uoPz9TRlf1suS8WUJEb9knqTqSvTQ77mCD9MhM2vNxSkFSYJB0xgwaLf3Pi5CEz6Q52h3qOFAo Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:15:26.874881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52651960a8b6494193c5e8abc658a2dd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52651960a8b6494193c5e8abc658a2dd"}]}] Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 52651960a8b6494193c5e8abc658a2dd Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1717504809 Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: c89859a30a2442b8ae13fe0444782d9c Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1717504809-project Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.876493 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'b86196fd-45b1-4137-abe6-0dcea457440c'} Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:26.877375 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. Sep 08 16:15:26.878832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:15:26.880221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] Returning 404 to user: Instance b86196fd-45b1-4137-abe6-0dcea457440c could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:26.880221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cf07a871-a327-4f88-944b-f7e368cd9adb tempest-AttachVolumeShelveTestJSON-1717504809 tempest-AttachVolumeShelveTestJSON-1717504809-project] 10.222.0.27 "GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c" status: 404 len: 111 microversion: 2.20 time: 0.032500 Sep 08 16:15:26.880221 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 494/947] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Sep 8 16:15:26 2022] GET /compute/v2.1/servers/b86196fd-45b1-4137-abe6-0dcea457440c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 16:15:31.755426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b07cc90f-1cf9-4b38-ae5e-eff65c7c16e8 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Action: 'create', calling method: .version_select at 0x7f886053a160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-799820468", "metadata": {"Type": "work"}}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:15:32.067908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b07cc90f-1cf9-4b38-ae5e-eff65c7c16e8 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.433002 Sep 08 16:15:32.068547 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 454/948] 10.222.0.27 () {60 vars in 1156 bytes} [Thu Sep 8 16:15:31 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 16:15:32.084365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-728a824b-aaed-44b4-ab22-eed0e835f5d0 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Calling method '.version_select at 0x7f885bfec8b0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:32.138253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-728a824b-aaed-44b4-ab22-eed0e835f5d0 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067" status: 200 len: 352 microversion: 2.1 time: 0.060156 Sep 08 16:15:32.138914 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 495/949] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:32 2022] GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:33.153694 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fc50b104-13bc-413a-aee2-857208862167 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Calling method '.version_select at 0x7f88600b1a60>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.206660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fc50b104-13bc-413a-aee2-857208862167 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067" status: 200 len: 353 microversion: 2.1 time: 0.057412 Sep 08 16:15:33.207238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 455/950] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:33 2022] GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:33.221123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c6d9ba9b-b859-48ae-8692-c0e098d35ff6 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Calling method '.version_select at 0x7f886010ae50>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.270275 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c6d9ba9b-b859-48ae-8692-c0e098d35ff6 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067" status: 200 len: 353 microversion: 2.1 time: 0.053736 Sep 08 16:15:33.271092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 496/951] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:33 2022] GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:33.285003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a530368-91a5-4dda-9b19-c6e0e6bd63ad tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Calling method '.version_select at 0x7f8860062c10>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.352149 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1a530368-91a5-4dda-9b19-c6e0e6bd63ad tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067" status: 202 len: 0 microversion: 2.1 time: 0.071016 Sep 08 16:15:33.352721 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 456/952] 10.222.0.27 () {58 vars in 1248 bytes} [Thu Sep 8 16:15:33 2022] DELETE /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:15:33.361852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-72e3bf45-eb2b-4507-8e39-ec6ee9220f93 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Calling method '.version_select at 0x7f886004a8b0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:33.413401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-72e3bf45-eb2b-4507-8e39-ec6ee9220f93 tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067" status: 200 len: 352 microversion: 2.1 time: 0.056124 Sep 08 16:15:33.413974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 497/953] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:33 2022] GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:34.428007 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9ce21900-bfc4-4525-a22c-a7aced2c0e6d tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Calling method '.version_select at 0x7f8860145430>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:34.464479 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-9ce21900-bfc4-4525-a22c-a7aced2c0e6d tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] HTTP exception thrown: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9ce21900-bfc4-4525-a22c-a7aced2c0e6d tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Request method failure captured: Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 HTTP/1.1 Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhUjfdzzV6kCqG8Dcn-clT0Zm3Ew6dB58IvAgjSnd-TR8TlqsWui9TjU7IItRSpHoPLhkIIVhXnGMmd9Jrp9XY7mzK4kb-qtRu90ulZCclqcNSo-B8lYE081mh-rcoDUureE6yvm6s7n6OCSNA_trVcQd-4VXCHL8HoY5aELXDIwfn8 Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: f079600e361845c6aac08d07151d1dea Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-VolumesGetTestJSON-1326891006 Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:15:34.466705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f079600e361845c6aac08d07151d1dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f079600e361845c6aac08d07151d1dea", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f079600e361845c6aac08d07151d1dea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f079600e361845c6aac08d07151d1dea"}]}] Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-VolumesGetTestJSON-1326891006 Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: f079600e361845c6aac08d07151d1dea Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-VolumesGetTestJSON-1326891006 Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-VolumesGetTestJSON-1326891006-project Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 6d2416bd945d4acd9bb263cab2223f3e Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-VolumesGetTestJSON-1326891006-project Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '3a5629b5-30d9-4b54-a6e0-4ecdc020f067'} Sep 08 16:15:34.468358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. (HTTP 404) (Request-ID: req-93219232-fa68-41ad-9fec-4c3615778772) Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:34.469428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 16:15:34.471069 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 16:15:34.472797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9ce21900-bfc4-4525-a22c-a7aced2c0e6d tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] Returning 404 to user: Volume 3a5629b5-30d9-4b54-a6e0-4ecdc020f067 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9ce21900-bfc4-4525-a22c-a7aced2c0e6d tempest-VolumesGetTestJSON-1326891006 tempest-VolumesGetTestJSON-1326891006-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067" status: 404 len: 109 microversion: 2.1 time: 0.044033 Sep 08 16:15:34.474563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 457/954] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:34 2022] GET /compute/v2.1/os-volumes/3a5629b5-30d9-4b54-a6e0-4ecdc020f067 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:15:37.576363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-21f8d795-a5fd-45b2-998f-0c703017b555 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f886010a820>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:37.584580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:37.592175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=87 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:37.633636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-21f8d795-a5fd-45b2-998f-0c703017b555 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/049d6176-27d5-4690-8f4f-33b46ae0bcb6" status: 200 len: 351 microversion: 2.1 time: 0.061149 Sep 08 16:15:37.634359 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 498/955] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:37 2022] GET /compute/v2.1/os-volumes/049d6176-27d5-4690-8f4f-33b46ae0bcb6 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:39.047157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:39.048321 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:15:39.052613 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8e967b34-935c-4a4d-9078-629f4f600e53 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f8860145670>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:39.100439 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8e967b34-935c-4a4d-9078-629f4f600e53 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/cd709dcf-006b-4451-b516-ba42f42cb2f9" status: 200 len: 351 microversion: 2.1 time: 0.054972 Sep 08 16:15:39.101004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 458/956] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:39 2022] GET /compute/v2.1/os-volumes/cd709dcf-006b-4451-b516-ba42f42cb2f9 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:40.449078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a0068226-5feb-4fd8-a813-51b632cb9883 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f885bfec280>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.496255 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a0068226-5feb-4fd8-a813-51b632cb9883 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e502fd3f-2b80-43c6-9194-325fe97dd13e" status: 200 len: 351 microversion: 2.1 time: 0.051562 Sep 08 16:15:40.496822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 499/957] 10.222.0.27 () {58 vars in 1245 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes/e502fd3f-2b80-43c6-9194-325fe97dd13e => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:40.510693 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9bf98d35-51bd-4cc0-9c13-5ae5f2714360 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f88600b1430>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.594557 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9bf98d35-51bd-4cc0-9c13-5ae5f2714360 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088092 Sep 08 16:15:40.595228 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 459/958] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:40.609726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5bf35eaa-71c1-437f-a8ad-25b9a93f3066 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f88600b5b80>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.691372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5bf35eaa-71c1-437f-a8ad-25b9a93f3066 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085392 Sep 08 16:15:40.691986 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 500/959] 10.222.0.27 () {58 vars in 1149 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:40.706327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b30bc267-dd1c-424e-97c7-d4eeb1cdecf2 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f88602d3c10>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.790700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b30bc267-dd1c-424e-97c7-d4eeb1cdecf2 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088618 Sep 08 16:15:40.791281 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 460/960] 10.222.0.27 () {58 vars in 1134 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:40.805131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a411199c-b631-4cea-bbf7-b1f9b6fc9771 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f886004a940>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.886997 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a411199c-b631-4cea-bbf7-b1f9b6fc9771 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085553 Sep 08 16:15:40.887747 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 501/961] 10.222.0.27 () {58 vars in 1167 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:40.902305 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d3bf9f09-8e70-4037-aba4-b1ec0ca7c6bc tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f88601baaf0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:40.985848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d3bf9f09-8e70-4037-aba4-b1ec0ca7c6bc tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087449 Sep 08 16:15:40.986420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 461/962] 10.222.0.27 () {58 vars in 1170 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:41.004236 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8aace8cf-7171-4a72-b4cb-9c9f8cf82cf3 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f885bfd0700>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:41.097701 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8aace8cf-7171-4a72-b4cb-9c9f8cf82cf3 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.097590 Sep 08 16:15:41.098287 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 502/963] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 16:15:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:15:41.115471 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd042e2a-fac8-4d2b-a0ea-0c0a3f732379 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f8860226ca0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:41.197788 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fd042e2a-fac8-4d2b-a0ea-0c0a3f732379 tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086136 Sep 08 16:15:41.198360 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 462/964] 10.222.0.27 () {58 vars in 1188 bytes} [Thu Sep 8 16:15:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:15:41.212097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3a61e2ef-b914-4ddf-89b1-9d6045ab444f tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] Calling method '.version_select at 0x7f885bfee0d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:15:41.295710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3a61e2ef-b914-4ddf-89b1-9d6045ab444f tempest-VolumesTestJSON-1694566019 tempest-VolumesTestJSON-1694566019-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.087425 Sep 08 16:15:41.296372 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 503/965] 10.222.0.27 () {58 vars in 1155 bytes} [Thu Sep 8 16:15:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:06.786059 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-421405303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1361964657", "security_groups": [{"name": "tempest-secgroup-smoke-350650337"}], "block_device_mapping_v2": [{"uuid": "b816f0b9-b7af-4095-b6ef-931aa8135741", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f5102509-85cc-4d13-8399-20742dacc4a9"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:06.969588 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] validate_networks() for [('f5102509-85cc-4d13-8399-20742dacc4a9', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:16:07.790521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:07.791132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:07.791410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:07.791847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:07.792249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:07.802234 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:07.802715 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:07.803141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:07.803879 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:07.804322 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:07.804734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:07.823972 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:16:07.828197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Getting quotas for user 77aeaed3d55945e49b0eb6e3c0519294 and project 53275b4dc845465d8b0bfb50eacd14f6. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:16:07.888276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:16:07.890759 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b816f0b9-b7af-4095-b6ef-931aa8135741',volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:16:08.063908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR oslo.messaging._drivers.impl_rabbit [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [62c66623-ed9e-4eda-baa7-6ed8bca53ba3] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 16:16:09.077467 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO oslo.messaging._drivers.impl_rabbit [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [62c66623-ed9e-4eda-baa7-6ed8bca53ba3] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39450. Sep 08 16:16:09.094036 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-347e6a65-cdcb-48b0-9044-8e4b1c727aa0 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.313390 Sep 08 16:16:09.102863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 463/966] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:16:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:16:09.109249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-443e9894-5309-42e6-9319-0ccbade7fbc9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:09.121253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-443e9894-5309-42e6-9319-0ccbade7fbc9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:09.259172 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-443e9894-5309-42e6-9319-0ccbade7fbc9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:09.268550 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-443e9894-5309-42e6-9319-0ccbade7fbc9 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1094 microversion: 2.1 time: 0.165180 Sep 08 16:16:09.269662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 504/967] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:09 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1094 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:10.293011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:10.293678 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:10.301024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:10.301777 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:10.302201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:10.303062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:10.303687 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:10.304261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:10.373176 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:10.384830 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c6c925e4-c2f9-44b6-a373-bd2ae68b9167 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1192 microversion: 2.1 time: 0.096505 Sep 08 16:16:10.385697 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 464/968] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:10 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:11.408109 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:11.409326 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:11.421027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:11.424594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:11.425223 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:11.426002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:11.426536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:11.430904 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:11.609346 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:11.626686 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bd724558-de70-455c-a5f5-2ffefe89e382 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1277 microversion: 2.1 time: 0.222293 Sep 08 16:16:11.627282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 505/969] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:11 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:11.737355 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-733690540", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "networks": [{"uuid": "75680a5b-e494-4b93-92b8-84c1d376ee6a"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:11.794198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] validate_networks() for [('75680a5b-e494-4b93-92b8-84c1d376ee6a', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:16:12.404156 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:12.404677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:12.405159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:12.405567 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:12.405977 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:12.415288 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:12.415805 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:12.416241 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:12.417061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:12.423869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-03091e4c-6902-4efc-bcf2-f37dc54c3c8b req-a95df9bc-b5da-42f5-bdf2-f277179c3255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e", "tag": "edf6c5d4-ab84-4d91-a266-d2292021e2b2"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:12.430759 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:12.431202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:12.434816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-03091e4c-6902-4efc-bcf2-f37dc54c3c8b req-a95df9bc-b5da-42f5-bdf2-f277179c3255 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:12.435592 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-03091e4c-6902-4efc-bcf2-f37dc54c3c8b req-a95df9bc-b5da-42f5-bdf2-f277179c3255 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:12.436113 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-03091e4c-6902-4efc-bcf2-f37dc54c3c8b req-a95df9bc-b5da-42f5-bdf2-f277179c3255 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:12.448975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-03091e4c-6902-4efc-bcf2-f37dc54c3c8b req-a95df9bc-b5da-42f5-bdf2-f277179c3255 service nova] Creating event network-changed:edf6c5d4-ab84-4d91-a266-d2292021e2b2 for instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e on hv-cinder-85625 Sep 08 16:16:12.449531 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Getting quotas for project 2f722f1a8cc74bee978fe23ce9b6bf1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:16:12.453503 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Getting quotas for user b0d93e4e3e404b1799d3c64e86cb7049 and project 2f722f1a8cc74bee978fe23ce9b6bf1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:16:12.454619 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-03091e4c-6902-4efc-bcf2-f37dc54c3c8b req-a95df9bc-b5da-42f5-bdf2-f277179c3255 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 Sep 08 16:16:12.455866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 506/970] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:12.464755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:16:12.466959 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:16:12.512201 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f5864a54-a3d2-4e36-831c-77f43b779abe tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778750 Sep 08 16:16:12.512881 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 465/971] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:16:12.524694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-311545a4-d003-4a60-b629-3934a7055b97 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:12.525675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-311545a4-d003-4a60-b629-3934a7055b97 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:12.583340 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-311545a4-d003-4a60-b629-3934a7055b97 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:12.590194 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-311545a4-d003-4a60-b629-3934a7055b97 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1213 microversion: 2.1 time: 0.069701 Sep 08 16:16:12.590752 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 507/972] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:12 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:12.657634 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:12.658453 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:12.664668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:12.665163 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:12.665605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:12.666319 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:12.666779 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:12.667191 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:12.816917 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:12.827276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-47536ef8-f3f9-41ff-9df9-54ec9a2ca607 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.177422 Sep 08 16:16:12.831791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 466/973] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:12 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:13.615763 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:13.616403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:13.625149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:13.625688 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:13.626201 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:13.626960 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:13.627486 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:13.627975 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:13.689948 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:13.697830 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-e967b690-2f75-4848-ace1-e4dd9670998c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1217 microversion: 2.1 time: 0.087397 Sep 08 16:16:13.698402 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 508/974] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:13 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:13.858416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:13.859410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:13.870352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:13.871041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:13.871834 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:13.872961 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:13.873706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:13.874401 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:14.009568 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:14.017323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-38b16545-7043-4417-89b3-6c6af01cfbe6 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.165554 Sep 08 16:16:14.017923 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 467/975] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:13 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:14.721865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:14.723580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:14.731870 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:14.732354 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:14.732784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:14.733478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:14.733934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:14.734355 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:14.796359 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:14.804209 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8282852a-6f68-4f93-8526-8a34deeb0d40 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1217 microversion: 2.1 time: 0.087420 Sep 08 16:16:14.804770 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 509/976] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:14 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:15.040771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:15.041374 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:15.048167 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:15.048648 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:15.049080 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:15.049769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:15.050219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:15.050641 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:15.230444 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:15.238894 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-30ffa8a0-c921-42c1-a417-b3b85ecc5030 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.202511 Sep 08 16:16:15.239744 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 468/977] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:15 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:15.830059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:15.830666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:15.837489 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:15.838245 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:15.839082 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:15.839968 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:15.840572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:15.841175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:15.912835 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:15.920969 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-27499755-402c-41aa-8ffe-da01f8f710ad tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1273 microversion: 2.1 time: 0.094321 Sep 08 16:16:15.931466 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 510/978] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:15 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:16.262157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:16.263685 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:16.272307 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:16.272919 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:16.273577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:16.274813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:16.275350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:16.275819 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:16.491194 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:16.500029 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-59aa032d-9ad1-41cd-a805-86d62d845bce tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.242001 Sep 08 16:16:16.500600 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 469/979] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:16 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:16.944730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:16.945331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:16.952416 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:16.952899 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:16.953330 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:16.954021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:16.954470 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:16.954887 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:17.093692 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:17.101541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1f51be28-0589-4303-872c-76c8382f990e tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.160872 Sep 08 16:16:17.102116 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 511/980] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:16 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:17.526515 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:17.527516 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:17.537713 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:17.538202 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:17.538636 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:17.539323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:17.539818 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:17.540237 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:17.677203 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:17.685424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-40122fc5-4263-45cb-8854-69dbfc4e0738 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.165648 Sep 08 16:16:17.685999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 470/981] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:17 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:18.129039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:18.129970 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:18.140837 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:18.141625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:18.142336 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:18.143515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:18.144239 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:18.144936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:18.294761 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:18.302946 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-68ef462f-5aa4-467c-8f90-658524fbdc86 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.180529 Sep 08 16:16:18.303530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 512/982] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:18 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:18.710280 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:18.711043 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:18.720073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:18.720740 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:18.721347 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:18.722260 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:18.722893 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:18.723498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:18.867570 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:18.875741 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6e173b87-38d4-4354-9c72-551d9193035f tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.170553 Sep 08 16:16:18.876355 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 471/983] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:18 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:19.326230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:19.326841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:19.333811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:19.334512 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:19.335153 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:19.336218 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:19.336872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:19.337502 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:19.471096 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:19.479107 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0c17c1da-20e4-4476-9c08-75912e89633a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.156764 Sep 08 16:16:19.479759 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 513/984] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:19 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:19.901838 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:19.902455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:19.911308 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:19.911900 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:19.912337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:19.913027 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:19.913594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:19.914018 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:20.114104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:20.122092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fdfaab96-25d5-4903-8d11-baed3b2cfaca tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.225699 Sep 08 16:16:20.122679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 472/985] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:19 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:20.450581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-19736c6d-84af-436d-a20e-99290ce8b626 req-430e05ba-58ff-4ff8-b882-6db0847b97be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18053b6-c823-41a9-af32-99890a77af4b", "tag": "0eda5be4-02e4-4115-a92e-d08b9d10ef23"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:20.462780 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-19736c6d-84af-436d-a20e-99290ce8b626 req-430e05ba-58ff-4ff8-b882-6db0847b97be service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:20.463260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-19736c6d-84af-436d-a20e-99290ce8b626 req-430e05ba-58ff-4ff8-b882-6db0847b97be service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:20.463707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-19736c6d-84af-436d-a20e-99290ce8b626 req-430e05ba-58ff-4ff8-b882-6db0847b97be service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:20.475633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-19736c6d-84af-436d-a20e-99290ce8b626 req-430e05ba-58ff-4ff8-b882-6db0847b97be service nova] Creating event network-changed:0eda5be4-02e4-4115-a92e-d08b9d10ef23 for instance f18053b6-c823-41a9-af32-99890a77af4b on hv-cinder-85625 Sep 08 16:16:20.481144 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-19736c6d-84af-436d-a20e-99290ce8b626 req-430e05ba-58ff-4ff8-b882-6db0847b97be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034662 Sep 08 16:16:20.482429 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 514/986] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:20.508935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:20.510240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:20.516806 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:20.517640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:20.518115 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:20.518926 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:20.519431 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:20.519974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:20.740911 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:20.748993 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-75e69bc9-8d0a-4136-a964-a4dcf9e4c03a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.250517 Sep 08 16:16:20.749573 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 473/987] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:20 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:21.146883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:21.147633 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:21.154145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:21.154708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:21.155212 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:21.156023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:21.156577 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:21.157042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:21.292006 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:21.300280 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-75a644e1-3278-4058-b4bb-ea532d9643e3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.157608 Sep 08 16:16:21.300853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 515/988] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:21 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:21.774651 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:21.775244 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:21.782459 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:21.782945 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:21.783386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:21.784103 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:21.784558 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:21.784982 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:21.973245 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:21.981472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bc8be41a-1093-429f-9211-ca6f24dbf2b4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.212441 Sep 08 16:16:21.982050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 474/989] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:21 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:22.323870 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:22.324507 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:22.331854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:22.332343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:22.332778 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:22.333607 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:22.334070 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:22.334541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:22.481251 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:22.489386 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-7e2db0ef-bb6c-4259-85af-f7f40aca8617 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.169609 Sep 08 16:16:22.489955 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 516/990] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:22 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:23.009006 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:23.009592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:23.011502 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=4 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:23.012192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=12 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:23.019092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:23.019608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:23.020024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:23.020712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:23.021203 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:23.021619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:23.162787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:23.170905 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-b4e5091a-4a53-4f9c-bbc1-8a7c0052ce2d tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.168775 Sep 08 16:16:23.171509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 475/991] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:23 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:23.516905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:23.517893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:23.521034 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=4 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:23.530529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:23.531311 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:23.532064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:23.533181 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:23.533928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:23.534629 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:23.676094 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:23.686690 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-31aafa2d-9359-44b7-a7fe-27d1f2195562 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.176070 Sep 08 16:16:23.687558 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 517/992] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:23 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:24.194628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:24.195235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:24.201847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:24.202334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:24.202767 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:24.203483 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:24.203924 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:24.204345 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:24.333350 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:24.341180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-48190060-77e0-4994-8602-e2f06a07df42 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.150546 Sep 08 16:16:24.341756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 476/993] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:24 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:24.709996 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:24.710617 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:24.717918 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:24.718403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:24.718832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:24.719593 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:24.720095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:24.720556 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:25.008471 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:25.016693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0f95c906-8746-4997-a79e-a64fbcff94db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.310902 Sep 08 16:16:25.017232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 518/994] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:24 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:25.363773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:25.364394 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:25.371103 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:25.371832 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:25.372271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:25.372965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:25.373414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:25.373838 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:25.505122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:25.513455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4a161e81-9473-4ed9-9915-588332145baa tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.153617 Sep 08 16:16:25.514054 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 477/995] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:25 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:26.039601 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:26.040132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:26.046929 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:26.047413 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:26.047882 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:26.048572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:26.049025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:26.049446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:26.199418 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:26.207267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-fc9277c8-e0db-43ca-a6d5-ae334c7d8910 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.171743 Sep 08 16:16:26.207868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 519/996] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:26 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:26.538414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:26.539024 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:26.545632 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:26.546112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:26.546533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:26.547197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:26.547877 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:26.548297 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:26.683325 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:26.691768 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0a02945f-6165-48ba-945d-347e45e5f7ed tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.157344 Sep 08 16:16:26.692790 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 478/997] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:26 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:27.229921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:27.230525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:27.237411 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:27.237895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:27.238324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:27.239007 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:27.239491 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:27.239907 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:27.377721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:27.385881 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1af7470c-3f36-4a6d-85d1-65f099e9d85d tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.159864 Sep 08 16:16:27.386339 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 520/998] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:27 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:27.716226 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:27.717136 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:27.723615 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:27.724104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:27.724614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:27.725706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:27.726189 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:27.726613 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:27.864086 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:27.872267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1eecfb1f-bed4-438a-9a02-e83be2d3d1c5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.159993 Sep 08 16:16:27.873103 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 479/999] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:27 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:28.412014 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:28.412940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:28.423743 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:28.424539 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:28.425253 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:28.426388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:28.427132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:28.427892 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:28.572910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:28.581069 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-062dbc4f-88d8-4385-be12-a29065288121 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.175739 Sep 08 16:16:28.581635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 521/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:28 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:28.895287 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:28.895938 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:28.903075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:28.903635 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:28.904071 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:28.904773 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:28.905354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:28.905791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:29.039536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:29.042945 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=100 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:29.048372 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2b2da41d-c5ff-451d-9ffe-4941064d1f92 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.157010 Sep 08 16:16:29.048963 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 480/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:28 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:29.607063 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:29.607853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:29.616191 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:29.616749 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:29.617289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:29.618053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:29.618581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:29.619072 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:29.759992 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:29.768192 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d102258b-cb00-47fc-bb6c-72c1beca4957 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.166854 Sep 08 16:16:29.769121 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 522/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:29 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:29.894095 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-6457dda6-bc52-4473-a6f5-26ef4e64b2fe req-1a9d329c-af0b-4a95-a391-fc7c6d11be17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18053b6-c823-41a9-af32-99890a77af4b", "name": "network-vif-plugged", "status": "completed", "tag": "0eda5be4-02e4-4115-a92e-d08b9d10ef23"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:29.905811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6457dda6-bc52-4473-a6f5-26ef4e64b2fe req-1a9d329c-af0b-4a95-a391-fc7c6d11be17 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:29.906475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6457dda6-bc52-4473-a6f5-26ef4e64b2fe req-1a9d329c-af0b-4a95-a391-fc7c6d11be17 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:29.907044 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6457dda6-bc52-4473-a6f5-26ef4e64b2fe req-1a9d329c-af0b-4a95-a391-fc7c6d11be17 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:29.918964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-6457dda6-bc52-4473-a6f5-26ef4e64b2fe req-1a9d329c-af0b-4a95-a391-fc7c6d11be17 service nova] Creating event network-vif-plugged:0eda5be4-02e4-4115-a92e-d08b9d10ef23 for instance f18053b6-c823-41a9-af32-99890a77af4b on hv-cinder-85625 Sep 08 16:16:29.924349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-6457dda6-bc52-4473-a6f5-26ef4e64b2fe req-1a9d329c-af0b-4a95-a391-fc7c6d11be17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 Sep 08 16:16:29.924906 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 481/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:30.075830 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:30.076858 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:30.086908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:30.087772 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:30.088485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:30.089769 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:30.090481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:30.090930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:30.221298 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:30.224829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:30.229482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-913d96d6-9bae-44e1-96ce-74fa6241bf0c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.160200 Sep 08 16:16:30.230086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 523/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:30 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:30.791395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:30.792157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:30.798980 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:30.799463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:30.799919 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:30.800630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:30.801081 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:30.801499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:30.942767 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:30.950796 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-733ccbd2-519f-46cb-bd36-6c539418f86b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.163643 Sep 08 16:16:30.951387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 482/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:30 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:31.256500 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:31.257515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:31.269154 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:31.269952 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:31.270693 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:31.271845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:31.272596 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:31.273296 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:31.406582 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:31.414433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-db304d9e-69b2-4788-8c3e-4a70ce27e1bf tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.164503 Sep 08 16:16:31.415032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 524/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:31 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:31.978281 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:31.979347 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:31.986521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:31.987001 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:31.987425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:31.988144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:31.988596 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:31.989014 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:32.125088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.133011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4784d432-5334-4dd3-860a-7bcc4f1e6b37 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.161372 Sep 08 16:16:32.133628 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 483/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:31 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:32.438220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:32.438854 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:32.445504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:32.445977 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:32.446423 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:32.447115 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:32.447595 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:32.448016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:32.659681 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:32.667953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-05f68685-0715-498a-b521-60df85fd4503 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.233760 Sep 08 16:16:32.668523 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 525/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:32 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:33.034335 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-4585d875-83bc-4731-8c5a-e9e4f1c85cd7 req-51b9395a-9785-4c9d-9a37-350dc44c43e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:33.041266 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:33.041821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:33.048230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.048720 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.049104 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.049870 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.050332 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.050751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.056886 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4585d875-83bc-4731-8c5a-e9e4f1c85cd7 req-51b9395a-9785-4c9d-9a37-350dc44c43e0 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.058416 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4585d875-83bc-4731-8c5a-e9e4f1c85cd7 req-51b9395a-9785-4c9d-9a37-350dc44c43e0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.059257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-4585d875-83bc-4731-8c5a-e9e4f1c85cd7 req-51b9395a-9785-4c9d-9a37-350dc44c43e0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.072077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-4585d875-83bc-4731-8c5a-e9e4f1c85cd7 req-51b9395a-9785-4c9d-9a37-350dc44c43e0 service nova] Creating event network-changed:ad971a2b-7909-43cc-ae5d-c8907276f5de for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 on hv-cinder-85625 Sep 08 16:16:33.077795 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:16:33.080037 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-4585d875-83bc-4731-8c5a-e9e4f1c85cd7 req-51b9395a-9785-4c9d-9a37-350dc44c43e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048960 Sep 08 16:16:33.080994 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 526/1009] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:33.157319 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:33.158114 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:33.160507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4a0d93f4-c53e-48fa-a474-1c5f88052292 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 204 len: 0 microversion: 2.1 time: 0.133431 Sep 08 16:16:33.163525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 484/1010] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:16:33 2022] DELETE /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:16:33.166137 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.166860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.167775 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.168678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.169358 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.170128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.175170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:33.175920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:33.183812 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.184327 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.184865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.185623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.186495 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.186495 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.316542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:33.324896 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2543fed7-03ad-40ff-894d-aa1593d12325 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.172351 Sep 08 16:16:33.325675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 527/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:33 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:33.334722 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:33.343593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9b5d33f6-8e86-48c0-be8e-9487b71fe2ca tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.177771 Sep 08 16:16:33.344381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 485/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:33 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:33.691772 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:33.692381 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:33.698851 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.699331 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.699784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.700498 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:33.700911 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:33.701325 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:33.833895 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:33.843055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-633b5288-6595-4de8-bf15-ca08c0654ba8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.155177 Sep 08 16:16:33.843977 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 528/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:33 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:34.348224 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:34.348837 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:34.355501 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:34.355989 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:34.356406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:34.357089 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:34.357774 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:34.358190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:34.368831 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:34.369437 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:34.375471 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:34.375981 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:34.376393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:34.377348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:34.377848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:34.378447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:34.509697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.517839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a1cd1132-5a0a-492a-9194-74e5be7dc894 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.152802 Sep 08 16:16:34.518417 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 529/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:34 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:34.544604 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:34.552922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-54ce9a2e-4918-4c6a-9b1f-917c6f265d7a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.208832 Sep 08 16:16:34.553848 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 486/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:34 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:34.866591 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:34.867248 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:34.873821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:34.874304 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:34.874720 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:34.875376 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:34.875857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:34.876270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:35.043097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:35.051048 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-8a98f41b-3541-44cd-9a21-e501bc1a2da2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.188717 Sep 08 16:16:35.051659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 530/1016] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:34 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:35.541258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:35.542118 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:35.549021 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:35.549439 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:35.549908 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:35.550604 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:35.551050 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:35.551478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:35.576942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:35.577670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:35.584965 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:35.585458 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:35.585891 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:35.586602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:35.587125 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:35.587611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:35.726384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:35.730164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:35.735208 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-446c9936-cac4-4d87-855e-1186d0f163e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.162611 Sep 08 16:16:35.736329 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 531/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:35 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:35.740509 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-18a28781-2a79-44ad-bd64-d15ddc9fcfe3 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.203171 Sep 08 16:16:35.752132 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 487/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:35 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:36.075524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:36.076116 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:36.082877 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:36.083816 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:36.084444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:36.085265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:36.085986 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:36.086485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:36.306529 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:36.315257 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-cbe5e742-8919-42f0-b134-a852d8c32a45 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.244277 Sep 08 16:16:36.315902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 532/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:36 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:36.764489 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:36.765273 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:36.767668 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:36.768710 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:36.779030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:36.780735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:36.784107 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:36.785211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:36.785898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:36.786596 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:36.797401 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:36.808843 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:36.809847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:36.811760 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:36.817736 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:36.818735 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:36.819339 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:37.298208 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:37.386029 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d128fd66-9213-4394-be5b-84ef9ae22d9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.629343 Sep 08 16:16:37.397541 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 488/1020] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:36 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:37.417304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:37.435723 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:37.442748 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:37.445797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:37.446283 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:37.447000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:37.447860 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:37.448473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:37.516150 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:37.543643 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-efa7e383-7a3b-4ea2-aaa3-69b06a9f4ed8 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1568 microversion: 2.1 time: 0.781059 Sep 08 16:16:37.561442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 533/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:36 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1568 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:37.901910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:37.912035 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fafb375c-5f73-44ee-8ef3-50f3c33a4cae tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.497814 Sep 08 16:16:37.913235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 489/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:37 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:38.344005 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-1a8e8016-00b4-4fe1-9d76-a332ed000bf9 req-8b3d2b10-6065-4726-aa17-b650f9a21299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d33ef9ec-1173-489a-a3cc-5c98fe9ee293", "name": "network-vif-deleted", "tag": "ad971a2b-7909-43cc-ae5d-c8907276f5de"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:38.379541 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1a8e8016-00b4-4fe1-9d76-a332ed000bf9 req-8b3d2b10-6065-4726-aa17-b650f9a21299 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.385982 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1a8e8016-00b4-4fe1-9d76-a332ed000bf9 req-8b3d2b10-6065-4726-aa17-b650f9a21299 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.387387 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-1a8e8016-00b4-4fe1-9d76-a332ed000bf9 req-8b3d2b10-6065-4726-aa17-b650f9a21299 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:38.410760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-1a8e8016-00b4-4fe1-9d76-a332ed000bf9 req-8b3d2b10-6065-4726-aa17-b650f9a21299 service nova] Creating event network-vif-deleted:ad971a2b-7909-43cc-ae5d-c8907276f5de for instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 on hv-cinder-85625 Sep 08 16:16:38.422520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:38.424016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:38.426638 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-1a8e8016-00b4-4fe1-9d76-a332ed000bf9 req-8b3d2b10-6065-4726-aa17-b650f9a21299 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097347 Sep 08 16:16:38.428126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 534/1023] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:38.437134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.437495 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.437932 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:38.438645 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.439106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.439647 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:38.571204 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:38.571941 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:38.587963 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.589273 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.591265 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:38.593589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.602183 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.604161 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:38.761940 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.775897 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3170cb2d-949b-4e23-a2a9-ed153a43f573 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.359319 Sep 08 16:16:38.777041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 490/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:38 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:38.807004 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:38.822784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ba96c1bd-1506-49ab-ae67-4c710db6d387 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1219 microversion: 2.1 time: 0.256029 Sep 08 16:16:38.832815 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 535/1025] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:38 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:38.944920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:38.947291 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:38.957452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.958343 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.959041 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:38.960032 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:38.960712 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:38.963278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:39.196170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:39.217390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-544af4c4-3263-4141-9f23-7121efc99c80 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1313 microversion: 2.1 time: 0.281773 Sep 08 16:16:39.219157 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 491/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:38 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:39.803827 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:39.805043 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:39.814012 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=69 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:39.816120 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:39.817301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:39.822580 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:39.824410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:39.825670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:39.826528 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:39.856409 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:39.857698 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:39.866105 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:39.866697 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:39.867205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:39.868193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:39.868970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:39.869710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:39.929935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:39.930426 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:39.933852 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:39.934352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lazy-loading 'fault' on Instance uuid d33ef9ec-1173-489a-a3cc-5c98fe9ee293 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:16:39.995584 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3be588325bf40beae354c1237d8e9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2245b7557087417bb8a32322c8673cef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.013414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-92271520-155e-4c79-80eb-c67be402e573 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 200 len: 1341 microversion: 2.1 time: 0.162410 Sep 08 16:16:40.015611 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 492/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:39 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:40.049259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-7ecb2d23-b5eb-4c34-ae59-82b9553fd885 req-9b4b610c-e7fe-4938-8479-71ce135a25c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e", "name": "network-vif-plugged", "status": "completed", "tag": "edf6c5d4-ab84-4d91-a266-d2292021e2b2"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:40.066574 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-7ecb2d23-b5eb-4c34-ae59-82b9553fd885 req-9b4b610c-e7fe-4938-8479-71ce135a25c6 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:40.068710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-7ecb2d23-b5eb-4c34-ae59-82b9553fd885 req-9b4b610c-e7fe-4938-8479-71ce135a25c6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:40.069487 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-7ecb2d23-b5eb-4c34-ae59-82b9553fd885 req-9b4b610c-e7fe-4938-8479-71ce135a25c6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:40.070547 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.085640 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-b3f58c89-c524-4d3b-ba3b-c9b63524fd9a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.286681 Sep 08 16:16:40.086871 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-7ecb2d23-b5eb-4c34-ae59-82b9553fd885 req-9b4b610c-e7fe-4938-8479-71ce135a25c6 service nova] Creating event network-vif-plugged:edf6c5d4-ab84-4d91-a266-d2292021e2b2 for instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e on hv-cinder-85625 Sep 08 16:16:40.093472 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-7ecb2d23-b5eb-4c34-ae59-82b9553fd885 req-9b4b610c-e7fe-4938-8479-71ce135a25c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050701 Sep 08 16:16:40.094597 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 493/1028] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:16:40.100025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 536/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:39 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:40.245261 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:40.247155 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:40.255708 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:40.256626 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:40.257336 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:40.258602 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:40.259421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:40.260111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:40.466188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:40.475975 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0585c903-3912-4cab-ab50-ff7a60d311f4 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1497 microversion: 2.1 time: 0.236405 Sep 08 16:16:40.479766 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 494/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:40 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1497 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:41.024482 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:41.025145 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:41.032795 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.040112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:41.040943 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] [instance: d33ef9ec-1173-489a-a3cc-5c98fe9ee293] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:41.044057 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.044670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.045604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.046167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.046692 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.048859 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.049623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.050231 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.051121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.051948 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.052429 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.068575 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] HTTP exception thrown: Instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 could not be found. Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Request method failure captured: Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 HTTP/1.1 Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhQ6xhqG287mgZq5ZXgd0ejGv3JKjKucS_DVlym5yTSHtSkFReVOGrciZVbLMaRVXsoAVJvvsC798ms4QlC5XNffIL9iyXMwhGjLLrjtYjq4scYwyBbzadkyWNnFPbZxCSGIc92yp60LefAYBl3ORr1mAr4F6Zzwcdy6Y2-9oOGPLYQ Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 2245b7557087417bb8a32322c8673cef Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestShelveInstance-745189534 Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:16:41.070258 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2245b7557087417bb8a32322c8673cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2245b7557087417bb8a32322c8673cef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2245b7557087417bb8a32322c8673cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2245b7557087417bb8a32322c8673cef"}]}] Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestShelveInstance-745189534 Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 2245b7557087417bb8a32322c8673cef Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestShelveInstance-745189534 Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestShelveInstance-745189534-project Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: f3be588325bf40beae354c1237d8e9ea Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestShelveInstance-745189534-project Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 could not be found. Sep 08 16:16:41.071947 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'd33ef9ec-1173-489a-a3cc-5c98fe9ee293'} Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 could not be found. Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:16:41.072958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 could not be found. Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 could not be found. Sep 08 16:16:41.074577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:16:41.077052 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Returning 404 to user: Instance d33ef9ec-1173-489a-a3cc-5c98fe9ee293 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:16:41.078268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-7234c9bf-b797-4653-a52c-6e319204773c tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293" status: 404 len: 111 microversion: 2.1 time: 0.043721 Sep 08 16:16:41.079324 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 495/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:41 2022] GET /compute/v2.1/servers/d33ef9ec-1173-489a-a3cc-5c98fe9ee293 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:16:41.084000 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:16:41.109802 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:41.110417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:41.122352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.122944 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.123380 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.124124 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.127660 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.128359 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.217687 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3002beb7-f609-4743-946a-d1dcf1222ea2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 204 len: 0 microversion: 2.1 time: 0.196961 Sep 08 16:16:41.218888 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 537/1032] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:16:41 2022] DELETE /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:16:41.228154 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:41.229140 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:41.236698 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.238101 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.238741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.239730 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:41.240424 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:41.240844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:41.369763 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:41.411170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f7d44f72-2a2a-49cf-8294-a289f7107003 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1265 microversion: 2.1 time: 0.301178 Sep 08 16:16:41.413831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 496/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:41 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:41.421325 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-da951d79-1164-4ade-bb99-826eebc5dda4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] Calling method '.version_select at 0x7f88602265e0>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:41.486769 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-da951d79-1164-4ade-bb99-826eebc5dda4 tempest-TestShelveInstance-745189534 tempest-TestShelveInstance-745189534-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-261248473" status: 202 len: 0 microversion: 2.1 time: 0.071472 Sep 08 16:16:41.487881 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 497/1034] 10.222.0.27 () {58 vars in 1251 bytes} [Thu Sep 8 16:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-261248473 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:16:41.576236 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:41.598570 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-928ce004-4eb4-49eb-b8ce-26e96c954f3f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1503 microversion: 2.1 time: 0.375378 Sep 08 16:16:41.611694 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 538/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:41 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:42.439312 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:42.440594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:42.453073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:42.453855 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:42.456649 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:42.457499 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:42.458626 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:42.459188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:42.480414 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:42.624301 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:42.625819 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:42.632641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:42.633412 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:42.633932 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:42.634721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:42.635811 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:42.636699 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:42.700687 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:42.716959 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-aa49c0dd-fe23-479b-a365-a24551236949 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1452 microversion: 2.1 time: 0.284657 Sep 08 16:16:42.718328 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 498/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:42 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1452 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:42.743578 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:42.744253 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:42.751798 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:42.752442 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:42.753141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:42.753962 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:42.754571 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:42.755192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:42.893232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:42.910507 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-dbe2ec75-98ea-44ed-955a-d0c14146ccb6 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1503 microversion: 2.1 time: 0.289626 Sep 08 16:16:42.911832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 539/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:42 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:43.268365 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:43.277354 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-5eab2050-26a5-42c5-8dba-421fbfaf2572 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1452 microversion: 2.1 time: 0.540296 Sep 08 16:16:43.281383 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 499/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:42 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1452 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:16:43.935581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:43.936206 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:43.955064 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:43.956680 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:43.957448 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:43.959470 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:43.961220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:43.961887 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:43.970447 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:44.159845 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:44.181384 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-97a05346-e4e7-4ee2-b190-b4f69e79be81 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 200 len: 1461 microversion: 2.1 time: 0.250397 Sep 08 16:16:44.192545 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 540/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:43 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 1461 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:44.261752 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-d67f269f-e009-4f6c-a367-b9810e8df8ae req-98065c8e-971d-40d5-b73b-5281ac255b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18053b6-c823-41a9-af32-99890a77af4b", "name": "network-vif-deleted", "tag": "0eda5be4-02e4-4115-a92e-d08b9d10ef23"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:44.279900 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d67f269f-e009-4f6c-a367-b9810e8df8ae req-98065c8e-971d-40d5-b73b-5281ac255b3b service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:44.280827 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d67f269f-e009-4f6c-a367-b9810e8df8ae req-98065c8e-971d-40d5-b73b-5281ac255b3b service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:44.281463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-d67f269f-e009-4f6c-a367-b9810e8df8ae req-98065c8e-971d-40d5-b73b-5281ac255b3b service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:44.305559 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-d67f269f-e009-4f6c-a367-b9810e8df8ae req-98065c8e-971d-40d5-b73b-5281ac255b3b service nova] Creating event network-vif-deleted:0eda5be4-02e4-4115-a92e-d08b9d10ef23 for instance f18053b6-c823-41a9-af32-99890a77af4b on hv-cinder-85625 Sep 08 16:16:44.316359 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-d67f269f-e009-4f6c-a367-b9810e8df8ae req-98065c8e-971d-40d5-b73b-5281ac255b3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064286 Sep 08 16:16:44.318835 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 500/1040] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:16:45.205993 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:45.206602 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: f18053b6-c823-41a9-af32-99890a77af4b] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:45.219237 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:45.219685 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:45.220122 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:45.220872 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:45.225016 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:45.225792 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:45.254244 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] HTTP exception thrown: Instance f18053b6-c823-41a9-af32-99890a77af4b could not be found. Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Request method failure captured: Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b HTTP/1.1 Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhVJD_skGNEZQcevvr7gJrQ9FN7WnZ3ch8EJ9j55PPt3BnIs0J53O6xnYfhxQqAD0-iCrk7u6pPuVCG9BltVi7ihffD_iW4k6OQ9UqXocBPl6KSCO1dccdLNFQCLw-nC83Ev1kzznZppq1qYjhbgMB5pREXKYEN9EQZqZIpsJ4nI09s Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 2f722f1a8cc74bee978fe23ce9b6bf1c Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesActionsTest-3356568 Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:16:45.259291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2f722f1a8cc74bee978fe23ce9b6bf1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2f722f1a8cc74bee978fe23ce9b6bf1c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2f722f1a8cc74bee978fe23ce9b6bf1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2f722f1a8cc74bee978fe23ce9b6bf1c"}]}] Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesActionsTest-3356568 Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 2f722f1a8cc74bee978fe23ce9b6bf1c Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesActionsTest-3356568 Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesActionsTest-3356568-project Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: b0d93e4e3e404b1799d3c64e86cb7049 Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesActionsTest-3356568-project Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance f18053b6-c823-41a9-af32-99890a77af4b could not be found. Sep 08 16:16:45.261055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': 'f18053b6-c823-41a9-af32-99890a77af4b'} Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f18053b6-c823-41a9-af32-99890a77af4b could not be found. Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:16:45.262046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f18053b6-c823-41a9-af32-99890a77af4b could not be found. Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f18053b6-c823-41a9-af32-99890a77af4b could not be found. Sep 08 16:16:45.263662 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:16:45.265032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Returning 404 to user: Instance f18053b6-c823-41a9-af32-99890a77af4b could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:16:45.266175 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ed6ef1a9-4040-4526-8e94-21c58d67ad66 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b" status: 404 len: 111 microversion: 2.1 time: 0.059038 Sep 08 16:16:45.266954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 541/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:45 2022] GET /compute/v2.1/servers/f18053b6-c823-41a9-af32-99890a77af4b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:16:45.511248 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-748207164", "imageRef": "6980fd10-43f5-4812-a13c-d0bc6e7daaee", "flavorRef": "452", "networks": [{"uuid": "75680a5b-e494-4b93-92b8-84c1d376ee6a"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:45.614225 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] validate_networks() for [('75680a5b-e494-4b93-92b8-84c1d376ee6a', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:16:46.564111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:16:46.564700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:16:46.565187 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:16:46.565688 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:16:46.566376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:16:46.585446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:46.586121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:46.586658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:46.589836 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:46.590690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:46.591245 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:46.634109 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Getting quotas for project 2f722f1a8cc74bee978fe23ce9b6bf1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:16:46.645373 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Getting quotas for user b0d93e4e3e404b1799d3c64e86cb7049 and project 2f722f1a8cc74bee978fe23ce9b6bf1c. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:16:46.671706 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:16:46.674594 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6980fd10-43f5-4812-a13c-d0bc6e7daaee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:16:46.753318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-aca6b404-87d9-4edd-87b8-a54e2d67d506 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.246232 Sep 08 16:16:46.769348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-6a776026-61e2-4b17-82df-f8ecd81ad59c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:46.774581 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-6a776026-61e2-4b17-82df-f8ecd81ad59c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:46.779048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 501/1042] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:16:46.938988 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-6a776026-61e2-4b17-82df-f8ecd81ad59c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:46.955678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-6a776026-61e2-4b17-82df-f8ecd81ad59c tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1213 microversion: 2.1 time: 0.192464 Sep 08 16:16:46.974118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 542/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:46 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:47.980749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:47.981387 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:47.990420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:47.991150 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:47.991799 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:47.992692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:47.993492 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:47.994739 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:48.148674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:48.162200 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-483f7eeb-aafa-4e35-8165-4a0f49b3b033 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1265 microversion: 2.1 time: 0.185426 Sep 08 16:16:48.163756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 502/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:47 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:48.664616 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-b254040b-beeb-4855-b4fb-4661270f4e94 req-29657086-8f95-4e38-a24e-ba7599390624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e", "tag": "edf6c5d4-ab84-4d91-a266-d2292021e2b2"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:48.694353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b254040b-beeb-4855-b4fb-4661270f4e94 req-29657086-8f95-4e38-a24e-ba7599390624 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:48.694940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b254040b-beeb-4855-b4fb-4661270f4e94 req-29657086-8f95-4e38-a24e-ba7599390624 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:48.695572 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-b254040b-beeb-4855-b4fb-4661270f4e94 req-29657086-8f95-4e38-a24e-ba7599390624 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:48.725443 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-b254040b-beeb-4855-b4fb-4661270f4e94 req-29657086-8f95-4e38-a24e-ba7599390624 service nova] Creating event network-changed:edf6c5d4-ab84-4d91-a266-d2292021e2b2 for instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e on hv-cinder-85625 Sep 08 16:16:48.760306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-b254040b-beeb-4855-b4fb-4661270f4e94 req-29657086-8f95-4e38-a24e-ba7599390624 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088841 Sep 08 16:16:48.762472 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 543/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:49.188318 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:49.189371 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:49.204548 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:49.211230 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:49.211896 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:49.212756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:49.218521 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:49.219135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:49.333631 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:49.345921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9d384b86-f791-462a-8ef4-a5661e195599 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1271 microversion: 2.1 time: 0.160152 Sep 08 16:16:49.346928 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 503/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:49 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:50.371300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:50.372641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:50.380360 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:50.381442 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:50.387910 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:50.389143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:50.389786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:50.390373 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:50.604485 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:50.615873 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5f5a5d10-79f6-4389-980f-a373c587bc59 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.249607 Sep 08 16:16:50.634269 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 544/1047] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:50 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:51.644275 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:51.644969 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:51.652508 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:51.652996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:51.653423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:51.654126 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:51.655146 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:51.655627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:52.066271 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:52.086262 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-24893ed8-3120-45c5-8ceb-7356f4d89815 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.451855 Sep 08 16:16:52.087136 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 504/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:51 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:52.161540 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-8572986d-a97e-4876-85fe-928a46b9e3e9 req-1a0d07a5-33e9-452d-bd4d-f3017cfd0f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9561e7-b039-4c56-b39b-44d032cd5ba6", "tag": "4acbd6b7-32ed-4427-8734-4af2a5092f80"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:52.179972 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8572986d-a97e-4876-85fe-928a46b9e3e9 req-1a0d07a5-33e9-452d-bd4d-f3017cfd0f23 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:52.181239 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8572986d-a97e-4876-85fe-928a46b9e3e9 req-1a0d07a5-33e9-452d-bd4d-f3017cfd0f23 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:52.182928 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-8572986d-a97e-4876-85fe-928a46b9e3e9 req-1a0d07a5-33e9-452d-bd4d-f3017cfd0f23 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:52.213719 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-8572986d-a97e-4876-85fe-928a46b9e3e9 req-1a0d07a5-33e9-452d-bd4d-f3017cfd0f23 service nova] Creating event network-changed:4acbd6b7-32ed-4427-8734-4af2a5092f80 for instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 on hv-cinder-85625 Sep 08 16:16:52.223407 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-8572986d-a97e-4876-85fe-928a46b9e3e9 req-1a0d07a5-33e9-452d-bd4d-f3017cfd0f23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065631 Sep 08 16:16:52.229697 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 545/1049] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:53.111135 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:53.111907 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:53.130910 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:53.133474 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:53.136672 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:53.137540 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:53.140182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:53.141475 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:53.659348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:53.669182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0dc526be-edbd-41d8-8b40-322859319ac8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.562675 Sep 08 16:16:53.670768 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 505/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:53 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:54.699204 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:54.702047 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:54.723860 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:54.724608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:54.726194 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:54.726939 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:54.729504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:54.731578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:54.964783 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:54.978356 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-250b5916-1e4b-4215-abc7-8508cdaa4b51 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.287883 Sep 08 16:16:54.980436 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 546/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:54 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:56.003430 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:56.004606 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:56.014579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:56.015064 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:56.015520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:56.016393 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:56.017000 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:56.017575 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:56.192277 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:56.201811 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-efb877e5-36db-4f74-90ca-872242d666a5 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.202973 Sep 08 16:16:56.202930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 506/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:55 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:57.225930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:57.226520 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:57.232436 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:57.238315 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:57.239130 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:57.239916 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:57.240791 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:57.241404 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:57.241989 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:57.420025 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:57.430962 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-56875350-8bc7-4052-af37-91cf08283c1a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.209274 Sep 08 16:16:57.432608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 547/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:57 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:58.163857 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-02173269-4db4-41d4-ac08-13bac19ff64f req-b5d24219-758f-4d40-8e3c-e41be9565252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9561e7-b039-4c56-b39b-44d032cd5ba6", "name": "network-vif-plugged", "status": "completed", "tag": "4acbd6b7-32ed-4427-8734-4af2a5092f80"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:16:58.177457 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:58.180750 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=6 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:16:58.184227 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-02173269-4db4-41d4-ac08-13bac19ff64f req-b5d24219-758f-4d40-8e3c-e41be9565252 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:58.192392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-02173269-4db4-41d4-ac08-13bac19ff64f req-b5d24219-758f-4d40-8e3c-e41be9565252 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:58.192964 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-02173269-4db4-41d4-ac08-13bac19ff64f req-b5d24219-758f-4d40-8e3c-e41be9565252 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:58.213638 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-02173269-4db4-41d4-ac08-13bac19ff64f req-b5d24219-758f-4d40-8e3c-e41be9565252 service nova] Creating event network-vif-plugged:4acbd6b7-32ed-4427-8734-4af2a5092f80 for instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 on hv-cinder-85625 Sep 08 16:16:58.220807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-02173269-4db4-41d4-ac08-13bac19ff64f req-b5d24219-758f-4d40-8e3c-e41be9565252 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060551 Sep 08 16:16:58.222603 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 507/1054] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:16:58.462548 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:58.463344 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:58.470365 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:58.471124 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:58.471853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:58.472780 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:58.473449 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:58.474228 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:58.614144 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:58.622196 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-506fa671-9385-4574-810a-07c4d836e29f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.165648 Sep 08 16:16:58.623001 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 548/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:58 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:16:59.646665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:16:59.647700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:16:59.656844 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:59.657332 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:59.657807 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:59.658522 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:16:59.658974 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:16:59.659427 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:16:59.832417 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:16:59.842161 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-843147ff-288b-44c8-8815-6250ad5827a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1313 microversion: 2.1 time: 0.200001 Sep 08 16:16:59.856320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 508/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:16:59 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:00.869345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:00.870011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:00.877267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:00.877774 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:00.878210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:00.878940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:00.879401 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:00.879866 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:01.023115 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:01.031961 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a923f852-f552-4490-8709-a2c81917b5ea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1497 microversion: 2.1 time: 0.166507 Sep 08 16:17:01.032771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 549/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:00 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:01.539034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:01.539611 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:01.546348 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:01.546991 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:01.547436 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:01.548164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:01.548643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:01.549068 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:01.582107 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:17:01.666654 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-bb15d64b-9542-4cdd-b9ac-4ba21c942aea tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 204 len: 0 microversion: 2.1 time: 0.131320 Sep 08 16:17:01.667349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 509/1058] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:17:01 2022] DELETE /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:17:01.677083 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:01.678049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:01.684322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:01.684797 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:01.685234 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:01.685919 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:01.686369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:01.686789 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:01.705047 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-daef5bfd-2b1d-4a16-8149-bd6a5fefcc51 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Action: 'create', calling method: .version_select at 0x7f88604d44c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-508642010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjtyNONxligpvIoa1O29koSBbmERJsxdsY46ultaX04idTDZ4iie38d0TIAG//NBRVhHI5kbpXRavlYg1Fc4KFGkbvSLJkWg+DkLtM6c7Sr8nWIyAvli0iYf2sDMaCH7g=="}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:01.720353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-daef5bfd-2b1d-4a16-8149-bd6a5fefcc51 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Getting quotas for project 223d0d2bc7a54f5b9ccc4b4414604d87. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:17:01.724423 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-daef5bfd-2b1d-4a16-8149-bd6a5fefcc51 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Getting quotas for user d87960cdc11f47e2ac431484d3a56bd2 and project 223d0d2bc7a54f5b9ccc4b4414604d87. Resources: {'key_pairs'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:17:01.748046 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-daef5bfd-2b1d-4a16-8149-bd6a5fefcc51 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047145 Sep 08 16:17:01.748676 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 510/1059] 10.222.0.27 () {60 vars in 1159 bytes} [Thu Sep 8 16:17:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:01.816108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:01.823776 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-bcc11693-b419-4df4-a624-806db9bf2812 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1503 microversion: 2.1 time: 0.151564 Sep 08 16:17:01.824350 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 550/1060] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:01 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:01.852829 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1616404880", "imageRef": "09f743ca-af19-4e38-9cdd-a1867c827ae0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-508642010", "networks": [{"uuid": "17801574-e2de-47aa-98c9-b6c6a7c7b9ad"}]}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:01.907337 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.network.neutron [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] validate_networks() for [('17801574-e2de-47aa-98c9-b6c6a7c7b9ad', None, None, None, None, None)] {{(pid=120782) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 16:17:02.278569 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Flavor limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 16:17:02.279205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Image limits 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 16:17:02.279960 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Flavor pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 16:17:02.280643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Image pref 0:0:0 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 16:17:02.281213 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.virt.hardware [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120782) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 16:17:02.294787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:02.295543 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:02.296437 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:02.297491 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:02.298091 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:02.298710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:02.318866 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Getting quotas for project 223d0d2bc7a54f5b9ccc4b4414604d87. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 16:17:02.322875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.quota [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Getting quotas for user d87960cdc11f47e2ac431484d3a56bd2 and project 223d0d2bc7a54f5b9ccc4b4414604d87. Resources: {'ram', 'instances', 'cores'} {{(pid=120782) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 16:17:02.334646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Going to run 1 instances... {{(pid=120782) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 16:17:02.336963 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09f743ca-af19-4e38-9cdd-a1867c827ae0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120782) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 16:17:02.382677 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4dd9fda9-0f69-42dd-b5aa-f6dade66d6de tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533789 Sep 08 16:17:02.383341 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 511/1061] 10.222.0.27 () {60 vars in 1147 bytes} [Thu Sep 8 16:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 16:17:02.394653 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-3d2699f8-93d8-40c6-8ba1-d4daee099255 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:02.395366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-3d2699f8-93d8-40c6-8ba1-d4daee099255 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:02.449135 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-3d2699f8-93d8-40c6-8ba1-d4daee099255 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:02.456285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-3d2699f8-93d8-40c6-8ba1-d4daee099255 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1258 microversion: 2.1 time: 0.065549 Sep 08 16:17:02.456853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 551/1062] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:02 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:02.848565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:02.849189 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:02.856657 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:02.857144 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:02.857579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:02.858279 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:02.858732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:02.859160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:02.998583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:03.006729 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a54dc18e-b142-451c-b0c0-d7a1738a13c8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1503 microversion: 2.1 time: 0.164057 Sep 08 16:17:03.007334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 512/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:02 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:17:03.478782 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:03.479477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:03.490504 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:03.491225 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:03.491898 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:03.492790 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:03.493481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:03.494108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:03.545219 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0dd76d99-0f69-4106-969f-17dc08cc199d req-39dab6c3-1163-4485-bfec-fe86e762f203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9561e7-b039-4c56-b39b-44d032cd5ba6", "name": "network-vif-deleted", "tag": "4acbd6b7-32ed-4427-8734-4af2a5092f80"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:03.550381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:03.556174 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0dd76d99-0f69-4106-969f-17dc08cc199d req-39dab6c3-1163-4485-bfec-fe86e762f203 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:03.557062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0dd76d99-0f69-4106-969f-17dc08cc199d req-39dab6c3-1163-4485-bfec-fe86e762f203 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:03.557504 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0dd76d99-0f69-4106-969f-17dc08cc199d req-39dab6c3-1163-4485-bfec-fe86e762f203 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:03.572945 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:03.582148 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-f743bdf9-c6bd-499b-88f3-8a119cf83bcd tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1310 microversion: 2.1 time: 0.107206 Sep 08 16:17:03.582741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 552/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:03 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:03.596320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0dd76d99-0f69-4106-969f-17dc08cc199d req-39dab6c3-1163-4485-bfec-fe86e762f203 service nova] Creating event network-vif-deleted:4acbd6b7-32ed-4427-8734-4af2a5092f80 for instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 on hv-cinder-85625 Sep 08 16:17:03.603432 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0dd76d99-0f69-4106-969f-17dc08cc199d req-39dab6c3-1163-4485-bfec-fe86e762f203 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062034 Sep 08 16:17:03.604622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 513/1065] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:04.031717 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:04.032614 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:04.038635 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:04.039211 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:04.039702 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:04.040470 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:04.041380 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:04.042123 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:04.076414 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:04.076885 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:04.077684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:04.078150 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:04.131259 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:04.153488 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0639fd00-f792-4977-ac26-c3a13abff56a tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.125768 Sep 08 16:17:04.154170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 553/1066] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:04 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:04.613075 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:04.614659 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:04.624854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:04.625718 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:04.626295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:04.627177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:04.627803 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:04.628376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:04.788956 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:04.798304 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-830ed9f4-7033-4f22-9b2b-ebde6d70ce9f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.191781 Sep 08 16:17:04.799197 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 514/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:04 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:05.179166 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:05.180610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:05.188621 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:05.189481 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:05.190197 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:05.191494 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:05.192227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:05.192917 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:05.228116 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:05.228741 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:05.229170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:05.229620 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:05.271992 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:05.281537 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-68d12b48-c45d-4094-b142-9b064ab0b9bc tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.106613 Sep 08 16:17:05.287780 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 554/1068] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:05 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:05.822367 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:05.823842 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:05.831235 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:05.832108 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:05.832783 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:05.833717 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:05.834353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:05.834781 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:05.983734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:05.992640 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-06fcc6ad-b934-4825-970c-91e48dd3fbf5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.174133 Sep 08 16:17:05.993240 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 515/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:05 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:06.367926 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:06.368526 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:06.376285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:06.377112 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:06.377771 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:06.378756 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:06.379432 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:06.379848 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:06.419530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:06.420297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:06.421059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:06.421670 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:06.465129 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:06.473514 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-377b487e-5b61-4069-9c63-25d39d4171e2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.110560 Sep 08 16:17:06.474181 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 555/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:06 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:07.020764 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:07.022061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:07.029658 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:07.030136 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:07.030740 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:07.031721 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:07.032173 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:07.032615 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:07.167971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:07.176178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-31daa9d9-400f-4c70-938d-1b42930e12b2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.159981 Sep 08 16:17:07.176787 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 516/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:07 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:07.497535 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:07.498240 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:07.504979 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:07.505455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:07.505929 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:07.506631 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:07.507080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:07.507779 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:07.541210 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:07.541934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:07.542439 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:07.543086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:07.585438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:07.593267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1f7318e2-6f0c-4b51-80af-34b6fa20cece tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.099991 Sep 08 16:17:07.593834 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 556/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:07 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:08.201062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:08.201780 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:08.208850 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:08.209433 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:08.209922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:08.210619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:08.211073 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:08.211525 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:08.355920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:08.363340 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:08.366523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-78101c73-26bb-40c4-8057-97834de25a47 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.169584 Sep 08 16:17:08.367369 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 517/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:08 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:08.616812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:08.617444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:08.624343 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:08.624832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:08.625267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:08.625971 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:08.627116 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:08.627760 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:08.661463 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:08.661950 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:08.662364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:08.662786 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:08.717046 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:08.725347 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-c5785d13-edd0-4162-93ed-b61ca183e0ce tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.112484 Sep 08 16:17:08.725923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 557/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:08 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:09.390465 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:09.391106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:09.399522 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:09.400034 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:09.400562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:09.401282 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:09.401738 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:09.402170 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:09.562821 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:09.571190 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1a849623-71c7-4d62-b1e7-861e7bef108c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.185160 Sep 08 16:17:09.572234 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 518/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:09 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:09.748637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:09.750019 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:09.757094 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:09.757953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:09.758608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:09.759659 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:09.760323 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:09.760953 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:09.795317 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:09.796079 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:09.796641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:09.797202 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:09.839576 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:09.843424 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=100 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:09.848522 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-75ae3ec0-2869-46a4-8098-8becbf064108 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.103716 Sep 08 16:17:09.863477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 558/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:09 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:10.595212 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:10.596788 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:10.605498 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:10.606359 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:10.607018 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:10.608154 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:10.608865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:10.609406 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:10.750939 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:10.758832 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c9f8be73-4cf2-48b2-a869-88d204f5fc57 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.167833 Sep 08 16:17:10.759418 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 519/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:10 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:10.874706 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:10.875636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:10.878357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:10.884726 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:10.885227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:10.885714 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:10.886388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:10.886858 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:10.887272 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:10.924168 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:10.924780 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:10.925378 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:10.925875 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:10.973585 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:10.982039 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-5f846417-a832-4ab8-a1ac-fb0a3a35701f tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.113054 Sep 08 16:17:10.983089 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 559/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:10 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:11.782481 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:11.783243 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:11.791921 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:11.792996 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:11.793455 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:11.794186 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:11.794679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:11.795111 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:11.942159 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:11.953985 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-a4b0a7cd-847d-4c16-bf26-fb0d1ed6be98 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.176002 Sep 08 16:17:11.954724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 520/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:11 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:12.004832 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:12.005433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:12.012530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:12.013009 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:12.013438 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:12.014094 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:12.014569 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:12.014962 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:12.046217 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:12.046606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:12.047031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:12.047483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lazy-loading 'fault' on Instance uuid 3e9561e7-b039-4c56-b39b-44d032cd5ba6 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:17:12.089444 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0d93e4e3e404b1799d3c64e86cb7049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f722f1a8cc74bee978fe23ce9b6bf1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:12.097393 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-4cafa21f-7f35-4a0e-8b33-d3f6ca4a97a2 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 200 len: 1303 microversion: 2.1 time: 0.096442 Sep 08 16:17:12.097980 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 560/1080] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:11 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:12.978734 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:12.980268 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:12.984048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=2 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:12.985446 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell0:SELECT=10 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:12.990274 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:12.991088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:12.991720 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:12.992425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:12.992878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:12.993299 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:13.064403 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-53f21df7-3b95-4ba4-b340-e9b3fd0888bf req-b8571faf-b8c3-479c-b3df-be23a2cefa45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:13.071477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:13.079082 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-53f21df7-3b95-4ba4-b340-e9b3fd0888bf req-b8571faf-b8c3-479c-b3df-be23a2cefa45 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:13.079600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-53f21df7-3b95-4ba4-b340-e9b3fd0888bf req-b8571faf-b8c3-479c-b3df-be23a2cefa45 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:13.080030 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-53f21df7-3b95-4ba4-b340-e9b3fd0888bf req-b8571faf-b8c3-479c-b3df-be23a2cefa45 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:13.091188 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-53f21df7-3b95-4ba4-b340-e9b3fd0888bf req-b8571faf-b8c3-479c-b3df-be23a2cefa45 service nova] Creating event network-changed:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:17:13.096613 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-53f21df7-3b95-4ba4-b340-e9b3fd0888bf req-b8571faf-b8c3-479c-b3df-be23a2cefa45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035981 Sep 08 16:17:13.097451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 561/1081] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:13.121167 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:13.121990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] [instance: 3e9561e7-b039-4c56-b39b-44d032cd5ba6] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:13.129516 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:13.130002 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:13.130437 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:13.131126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:13.131611 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:13.132031 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:13.145711 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] HTTP exception thrown: Instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 could not be found. Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Request method failure captured: Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 HTTP/1.1 Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhVJD_skGNEZQcevvr7gJrQ9FN7WnZ3ch8EJ9j55PPt3BnIs0J53O6xnYfhxQqAD0-iCrk7u6pPuVCG9BltVi7ihffD_iW4k6OQ9UqXocBPl6KSCO1dccdLNFQCLw-nC83Ev1kzznZppq1qYjhbgMB5pREXKYEN9EQZqZIpsJ4nI09s Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 2f722f1a8cc74bee978fe23ce9b6bf1c Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-VolumesActionsTest-3356568 Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:17:13.147391 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2f722f1a8cc74bee978fe23ce9b6bf1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2f722f1a8cc74bee978fe23ce9b6bf1c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2f722f1a8cc74bee978fe23ce9b6bf1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2f722f1a8cc74bee978fe23ce9b6bf1c"}]}] Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-VolumesActionsTest-3356568 Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 2f722f1a8cc74bee978fe23ce9b6bf1c Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-VolumesActionsTest-3356568 Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-VolumesActionsTest-3356568-project Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: b0d93e4e3e404b1799d3c64e86cb7049 Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-VolumesActionsTest-3356568-project Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 could not be found. Sep 08 16:17:13.149020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '3e9561e7-b039-4c56-b39b-44d032cd5ba6'} Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 could not be found. Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:17:13.150042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 could not be found. Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 could not be found. Sep 08 16:17:13.151605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:17:13.152846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] Returning 404 to user: Instance 3e9561e7-b039-4c56-b39b-44d032cd5ba6 could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:17:13.152846 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-2f0891fc-8407-4795-82fb-e5fc630061e8 tempest-VolumesActionsTest-3356568 tempest-VolumesActionsTest-3356568-project] 10.222.0.27 "GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6" status: 404 len: 111 microversion: 2.1 time: 0.032064 Sep 08 16:17:13.153095 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 562/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:13 2022] GET /compute/v2.1/servers/3e9561e7-b039-4c56-b39b-44d032cd5ba6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:17:13.184353 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:13.193480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-9ef5fbdd-6e64-4c5e-9e4b-7c0cfc8dcfb9 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.220143 Sep 08 16:17:13.194313 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 521/1083] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:12 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:14.217742 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:14.218305 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:14.225316 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:14.225822 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:14.226231 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:14.226921 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:14.227405 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:14.227863 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:14.364020 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:14.372367 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-99745960-c485-4256-9894-dda5571e25fe tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.158641 Sep 08 16:17:14.372940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 563/1084] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:14 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:15.399710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:15.400732 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:15.411679 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:15.412511 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:15.413196 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:15.414331 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:15.415083 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:15.415863 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:15.561185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:15.573185 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-13a60f3f-de51-4577-8b14-96703546158b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.179703 Sep 08 16:17:15.573958 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 522/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:15 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:16.604625 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:16.605232 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:16.612106 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:16.612610 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:16.613042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:16.613721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:16.614163 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:16.614578 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:16.745721 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:16.753545 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-15de528b-7e56-43fa-86c0-49fba5c26929 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.155058 Sep 08 16:17:16.754093 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 564/1086] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:16 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:17.776774 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:17.777386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:17.784689 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:17.785210 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:17.785742 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:17.786710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:17.787164 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:17.787622 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:17.915692 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:17.923392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-4581a326-5a4a-4ff5-b252-68b45c678471 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.150867 Sep 08 16:17:17.923981 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 523/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:17 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:18.947484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:18.948289 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:18.955559 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:18.956340 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:18.957028 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:18.958033 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:18.958562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:18.959056 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:19.096651 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:19.106272 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-32b0d800-f0ac-4cb0-9bd1-a49e84e9ac5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.162483 Sep 08 16:17:19.128923 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 565/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:18 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:20.135128 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:20.136395 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:20.143349 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:20.144637 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:20.145278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:20.146205 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:20.146865 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:20.147510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:20.324536 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:20.332756 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f6431d67-4c0d-4aa2-90fd-34a4249012ea tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.203175 Sep 08 16:17:20.333872 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 524/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:20 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:21.357050 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:21.358615 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:21.365074 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:21.365797 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:21.366230 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:21.367082 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:21.367600 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:21.368078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:21.512889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:21.531652 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9c31426f-d715-4820-90f0-1d50cde5939b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.178897 Sep 08 16:17:21.533478 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 566/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:21 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:22.330025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0d56d516-7c08-4cab-9a26-bae3d903a705 req-e565d085-2471-4fb7-8e21-78a6a452b548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "name": "network-vif-plugged", "status": "completed", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:22.349440 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0d56d516-7c08-4cab-9a26-bae3d903a705 req-e565d085-2471-4fb7-8e21-78a6a452b548 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:22.351705 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0d56d516-7c08-4cab-9a26-bae3d903a705 req-e565d085-2471-4fb7-8e21-78a6a452b548 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:22.352788 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0d56d516-7c08-4cab-9a26-bae3d903a705 req-e565d085-2471-4fb7-8e21-78a6a452b548 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:22.372077 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0d56d516-7c08-4cab-9a26-bae3d903a705 req-e565d085-2471-4fb7-8e21-78a6a452b548 service nova] Creating event network-vif-plugged:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:17:22.381256 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0d56d516-7c08-4cab-9a26-bae3d903a705 req-e565d085-2471-4fb7-8e21-78a6a452b548 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055918 Sep 08 16:17:22.382250 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 525/1091] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:22.559433 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:22.560097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:22.572537 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:22.574049 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:22.575282 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:22.577235 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:22.578389 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:22.579382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:22.757751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:22.767364 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-47a3b166-edab-4bd3-9bba-6ff4d75bfd61 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.212830 Sep 08 16:17:22.768079 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 567/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:22 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:23.795665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:23.797094 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:23.804953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:23.805690 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:23.806757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:23.807473 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:23.807937 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:23.808363 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:23.959934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:23.971519 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ffeab77b-7c7d-47cd-b9cb-4e40f10464a4 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1358 microversion: 2.1 time: 0.180542 Sep 08 16:17:23.983520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 526/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:23 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:24.994450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:24.995813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:25.003589 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.003943 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.004138 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.004829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.005318 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.005707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.150915 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:25.161471 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d7679ad1-0025-4915-a9dc-5f1ce5684eb5 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1547 microversion: 2.1 time: 0.170996 Sep 08 16:17:25.162357 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 568/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:24 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:25.188888 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:25.189580 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:25.197611 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.198189 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.198624 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.199323 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.199816 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.200397 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.362188 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:25.370920 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-2fa207bd-32c5-45a4-b533-eb1b82ade4b0 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1547 microversion: 2.1 time: 0.186799 Sep 08 16:17:25.371620 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 527/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:25 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1547 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:25.392794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:25.397677 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:25.398588 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Searching by: {'deleted': False, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87'} {{(pid=120783) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 16:17:25.405537 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.406011 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.406436 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.407150 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.407636 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.408059 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.507281 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.multi_cell_list [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120783) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 16:17:25.606893 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d452d86c-27f1-4a41-a5bd-fb8a0f8f4490 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217912 Sep 08 16:17:25.607525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 569/1096] 10.222.0.27 () {58 vars in 1125 bytes} [Thu Sep 8 16:17:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 16:17:25.621832 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:25.623055 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:25.632970 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.633479 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.634101 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.635178 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:25.636182 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:25.637004 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:25.798591 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:25.808581 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-630c5c8b-a522-4f3d-ba62-c125c9f14db3 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1547 microversion: 2.1 time: 0.192569 Sep 08 16:17:25.809196 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 528/1097] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:25 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1547 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:27.480349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df27cd3b-b240-419e-8a3f-892782a9349d"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:27.482678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:27.491608 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:27.492260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:27.492707 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:27.493410 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:27.493936 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:27.494349 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:27.770665 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-aec58fa8-3e07-4c8b-bcfc-10f39d98ee13 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294031 Sep 08 16:17:27.771328 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 570/1098] 10.222.0.27 () {60 vars in 1323 bytes} [Thu Sep 8 16:17:27 2022] POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:34.367985 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:34.368558 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:34.375193 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:34.375710 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:34.376134 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:34.376813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:34.377254 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:34.377667 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:34.514088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:34.526869 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-cfaac685-165c-45bc-aec8-8b0ac7b839af tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1593 microversion: 2.1 time: 0.162631 Sep 08 16:17:34.527416 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 529/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:34 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:36.602450 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-65d2ecaf-3e00-48ca-bed6-c0545e6878ec req-d678f6c0-48f0-48cc-9e92-b91342bf9cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:36.619883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell0:SELECT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:36.629731 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-65d2ecaf-3e00-48ca-bed6-c0545e6878ec req-d678f6c0-48f0-48cc-9e92-b91342bf9cd6 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:36.632247 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-65d2ecaf-3e00-48ca-bed6-c0545e6878ec req-d678f6c0-48f0-48cc-9e92-b91342bf9cd6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:36.632842 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-65d2ecaf-3e00-48ca-bed6-c0545e6878ec req-d678f6c0-48f0-48cc-9e92-b91342bf9cd6 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:36.649053 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-65d2ecaf-3e00-48ca-bed6-c0545e6878ec req-d678f6c0-48f0-48cc-9e92-b91342bf9cd6 service nova] Creating event network-changed:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:17:36.660908 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-65d2ecaf-3e00-48ca-bed6-c0545e6878ec req-d678f6c0-48f0-48cc-9e92-b91342bf9cd6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064911 Sep 08 16:17:36.664382 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 571/1100] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:17:37.858379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-297363799"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:37.858953 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:37.862326 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=34 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:17:37.866839 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:37.867381 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:37.867845 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:37.868538 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:37.868982 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:37.869565 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:38.007583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.network.security_group_api [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Adding security group 37183367-5e30-47be-a058-99ad6a839222 to port a912bb4d-d25e-4e9b-bbea-23a34ace75b7 Sep 08 16:17:38.333929 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-858e9a29-a3d8-43c5-82ac-a770af78e085 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action" status: 202 len: 0 microversion: 2.1 time: 0.480615 Sep 08 16:17:38.335493 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 530/1101] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:17:37 2022] POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:17:38.343888 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:17:38.344740 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:17:38.351806 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:38.352286 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:38.352708 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:38.353407 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:38.353841 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:38.354267 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:38.522492 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:17:38.531794 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-34980e9e-7133-4974-92c9-d9a118bd3e0c tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1757 microversion: 2.1 time: 0.192038 Sep 08 16:17:38.532465 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 572/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:17:38 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:17:38.682630 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-bfcd2385-4d09-41c3-8212-a7c13935f439 req-a4398548-4fd2-40fc-b42b-edc227ef7cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:17:38.692564 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bfcd2385-4d09-41c3-8212-a7c13935f439 req-a4398548-4fd2-40fc-b42b-edc227ef7cd2 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:17:38.693117 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bfcd2385-4d09-41c3-8212-a7c13935f439 req-a4398548-4fd2-40fc-b42b-edc227ef7cd2 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:17:38.693609 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-bfcd2385-4d09-41c3-8212-a7c13935f439 req-a4398548-4fd2-40fc-b42b-edc227ef7cd2 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:17:38.705042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-bfcd2385-4d09-41c3-8212-a7c13935f439 req-a4398548-4fd2-40fc-b42b-edc227ef7cd2 service nova] Creating event network-changed:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:17:38.710608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-bfcd2385-4d09-41c3-8212-a7c13935f439 req-a4398548-4fd2-40fc-b42b-edc227ef7cd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032103 Sep 08 16:17:38.711409 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 531/1103] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:10.750284 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:10.752521 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:10.754641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=31 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.755306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.756324 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 16:18:10.756488 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Thu Sep 8 16:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action (ip 10.222.0.27) !!! Sep 08 16:18:10.766334 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:10.766813 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:10.767242 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:10.767974 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:10.768427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:10.768844 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:10.849370 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-9e7c7d86-c5c1-4129-828f-cd004414de77 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action" status: 202 len: 0 microversion: 2.1 time: 0.105579 Sep 08 16:18:10.850089 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 573/1104] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:18:10 2022] POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:10.859019 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:10.860151 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:10.862364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=3 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.863008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=74 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:10.869668 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:10.870818 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:10.871813 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:10.872520 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:10.872971 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:10.873390 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:11.258016 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:11.266771 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-f7d8fec5-b403-4514-ab8c-84977c80ae5f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1749 microversion: 2.1 time: 0.412072 Sep 08 16:18:11.267364 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 532/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:10 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1749 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:12.295594 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:12.296724 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:12.307689 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:12.308477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:12.309180 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:12.310344 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:12.311080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:12.311840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:12.528131 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:12.540852 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1ffe82cb-9792-4b42-8ec5-fa697c21f8bc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.253074 Sep 08 16:18:12.541605 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 574/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:12 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:13.566078 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:13.566828 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:13.575506 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:13.576141 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:13.576673 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:13.577527 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:13.578129 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:13.578652 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:13.730352 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:13.742878 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-1e0b7dc6-4c61-48a3-b39c-c5bf83ca247f tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.181531 Sep 08 16:18:13.743646 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 533/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:13 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:14.769527 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:14.770132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:14.776876 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:14.777353 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:14.777776 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:14.778483 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:14.778930 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:14.779345 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:14.921150 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:14.929803 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-24bca0a9-d154-4a14-9328-0b7bb0d923f7 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.164779 Sep 08 16:18:14.930713 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 575/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:14 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:15.957922 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:15.958854 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:15.969449 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:15.969976 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:15.970410 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:15.971097 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:15.971576 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:15.972005 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:16.130379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:16.142674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fcbb3b18-ef94-4ef2-bd6d-b0cb36d691ff tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.191436 Sep 08 16:18:16.143259 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 534/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:15 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:17.166536 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:17.167097 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:17.176684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:17.177173 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:17.177606 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:17.178300 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:17.178912 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:17.179338 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:17.679718 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:17.688937 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-78d16bd6-1455-4789-9c1a-a38bb4dc10dc tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.526879 Sep 08 16:18:17.689520 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 576/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:17 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:17.892310 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:17.892883 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:17.900565 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-db21da56-7fcd-4161-bebd-46e2c6ed6001 req-a18d22e6-5a20-4f73-964e-03fb2aca4ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e", "tag": "edf6c5d4-ab84-4d91-a266-d2292021e2b2"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:17.910142 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-db21da56-7fcd-4161-bebd-46e2c6ed6001 req-a18d22e6-5a20-4f73-964e-03fb2aca4ede service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:17.910699 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-db21da56-7fcd-4161-bebd-46e2c6ed6001 req-a18d22e6-5a20-4f73-964e-03fb2aca4ede service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:17.911126 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-db21da56-7fcd-4161-bebd-46e2c6ed6001 req-a18d22e6-5a20-4f73-964e-03fb2aca4ede service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:17.911629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:17.912545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:17.912545 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:17.913267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:17.913868 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:17.914278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:17.923213 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-db21da56-7fcd-4161-bebd-46e2c6ed6001 req-a18d22e6-5a20-4f73-964e-03fb2aca4ede service nova] Creating event network-changed:edf6c5d4-ab84-4d91-a266-d2292021e2b2 for instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e on hv-cinder-85625 Sep 08 16:18:17.929143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-db21da56-7fcd-4161-bebd-46e2c6ed6001 req-a18d22e6-5a20-4f73-964e-03fb2aca4ede service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032179 Sep 08 16:18:17.930508 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 577/1111] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:17.942316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Going to try to terminate instance {{(pid=120782) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:18:18.025890 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-16a47e4a-73e5-447e-80de-40887d28332b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 204 len: 0 microversion: 2.1 time: 0.137299 Sep 08 16:18:18.030420 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 535/1112] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:18:17 2022] DELETE /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:18:18.036678 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:18.037398 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:18.043692 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:18.044170 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:18.044601 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:18.045288 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:18.045735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:18.046157 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:18.186724 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:18.195285 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-0a32d636-e3f1-4512-b734-25b9bc42f488 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1577 microversion: 2.1 time: 0.163350 Sep 08 16:18:18.195902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 578/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:18 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:18.713208 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:18.713904 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:18.720425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:18.720909 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:18.721330 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:18.722079 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:18.722523 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:18.723015 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:18.876106 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:18.884831 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8cb4a7fe-25c8-4dbd-b5ba-2ab1648c3302 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.176050 Sep 08 16:18:18.885408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 536/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:18 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:19.218555 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:19.219310 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:19.226154 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:19.226641 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:19.227077 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:19.227810 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:19.228302 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:19.228725 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:19.367957 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:19.375826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-96aeaf8f-335b-449b-91e6-ce74e25f27c2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1577 microversion: 2.1 time: 0.161286 Sep 08 16:18:19.376388 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 579/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:19 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:19.908700 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:19.909270 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:19.916123 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:19.916608 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:19.917023 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:19.917728 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:19.918174 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:19.918593 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:20.064428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:20.074619 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c021be7b-6b81-49a1-9dab-d11727010749 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.169755 Sep 08 16:18:20.087885 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 537/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:19 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:20.128700 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-6d0f447a-4afe-47b8-a478-fb0952d78cd1 req-b1c91fec-b22b-41ad-9158-2372d70942b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e", "name": "network-vif-deleted", "tag": "edf6c5d4-ab84-4d91-a266-d2292021e2b2"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:20.139121 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d0f447a-4afe-47b8-a478-fb0952d78cd1 req-b1c91fec-b22b-41ad-9158-2372d70942b0 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:20.139763 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d0f447a-4afe-47b8-a478-fb0952d78cd1 req-b1c91fec-b22b-41ad-9158-2372d70942b0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:20.140183 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-6d0f447a-4afe-47b8-a478-fb0952d78cd1 req-b1c91fec-b22b-41ad-9158-2372d70942b0 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:20.154812 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-6d0f447a-4afe-47b8-a478-fb0952d78cd1 req-b1c91fec-b22b-41ad-9158-2372d70942b0 service nova] Creating event network-vif-deleted:edf6c5d4-ab84-4d91-a266-d2292021e2b2 for instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e on hv-cinder-85625 Sep 08 16:18:20.160524 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-6d0f447a-4afe-47b8-a478-fb0952d78cd1 req-b1c91fec-b22b-41ad-9158-2372d70942b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 Sep 08 16:18:20.161143 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 580/1117] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:20.400121 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:20.400751 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:20.407489 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:20.408013 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:20.408443 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:20.409145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:20.409590 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:20.410008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:20.483605 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:20.492192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-0ba5e6a1-1fb3-48ad-98a5-7bfee00f5c22 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 200 len: 1225 microversion: 2.1 time: 0.095910 Sep 08 16:18:20.492760 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 538/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:20 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:21.107684 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:21.108868 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:21.119266 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:21.120114 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:21.120821 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:21.121934 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:21.122673 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:21.123363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:21.274021 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:21.283236 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-a05c5bc9-06cf-4ede-8cad-cd30535c4e2a tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.183626 Sep 08 16:18:21.283857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 581/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:21 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:21.518198 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:21.518965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:21.527861 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:21.528510 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:21.529088 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:21.530006 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:21.530614 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:21.531181 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:21.549061 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] HTTP exception thrown: Instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e could not be found. Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Request method failure captured: Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e HTTP/1.1 Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhPri3mzaSAG2ls7Qc10A2LBHxJWjfwV7Qg8n0GafcSQ_iEieNdBgLw9h29VkM29jCSKaXsUUONNnPH7XsoUwPFeweItJJQZqr0XkQQo1fi5WlJvrSkGeZDC68kMiQD_SMxaJeCJyzJzTDFvDVLhfCkAdkpoXwWf6acxGtUdZpSaaEw Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:18:21.550711 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53275b4dc845465d8b0bfb50eacd14f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}] Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 77aeaed3d55945e49b0eb6e3c0519294 Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e could not be found. Sep 08 16:18:21.552293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e'} Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e could not be found. Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:18:21.553238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e could not be found. Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e could not be found. Sep 08 16:18:21.554639 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:21.556812 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Returning 404 to user: Instance 46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:18:21.556812 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-fd898bc3-5953-49d4-8cf3-2cb4f7024ac3 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e" status: 404 len: 111 microversion: 2.1 time: 0.040489 Sep 08 16:18:21.556812 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 539/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:21 2022] GET /compute/v2.1/servers/46626bb8-29ef-4b7f-ac6d-1fe194fdfb6e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:18:22.311067 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:22.312092 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:22.322978 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:22.323899 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:22.324637 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:22.325784 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:22.326542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:22.327260 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:22.471772 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:22.480387 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-1e992416-3689-4167-b5cf-a57b6a01114e tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1754 microversion: 2.1 time: 0.176293 Sep 08 16:18:22.480990 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 582/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:22 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:23.508344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:23.509236 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:23.519696 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:23.520488 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:23.521195 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:23.522320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:23.523062 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:23.523804 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:23.669470 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:23.678421 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-3b2ab332-b69a-4c94-8513-a7598775513d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1757 microversion: 2.1 time: 0.176868 Sep 08 16:18:23.678990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 540/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:23 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:24.663278 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:24.663820 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:24.670590 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:24.671128 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:24.671597 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:24.671856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-e491e883-eecd-48d6-8924-fd1425383eea req-3ff6f7f6-eb60-44fd-99df-c759bccc0834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86f2f9b4-bf6c-45b3-b927-41d825203a5d", "tag": "83311939-ae7e-4703-90a1-f4c265746217"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:24.672291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:24.672699 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:24.673118 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:24.683249 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-e491e883-eecd-48d6-8924-fd1425383eea req-3ff6f7f6-eb60-44fd-99df-c759bccc0834 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:24.683757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-e491e883-eecd-48d6-8924-fd1425383eea req-3ff6f7f6-eb60-44fd-99df-c759bccc0834 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:24.684175 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-e491e883-eecd-48d6-8924-fd1425383eea req-3ff6f7f6-eb60-44fd-99df-c759bccc0834 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:24.704886 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-e491e883-eecd-48d6-8924-fd1425383eea req-3ff6f7f6-eb60-44fd-99df-c759bccc0834 service nova] Creating event network-changed:83311939-ae7e-4703-90a1-f4c265746217 for instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d on hv-cinder-85625 Sep 08 16:18:24.708889 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:18:24.711344 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-e491e883-eecd-48d6-8924-fd1425383eea req-3ff6f7f6-eb60-44fd-99df-c759bccc0834 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043112 Sep 08 16:18:24.712875 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 541/1123] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:24.812951 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-65241223-43c5-4e43-8837-cfb756afbed2 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "DELETE /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 204 len: 0 microversion: 2.1 time: 0.153447 Sep 08 16:18:24.813869 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 583/1124] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:18:24 2022] DELETE /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:18:24.823392 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:24.824125 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:24.830671 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:24.831180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:24.831643 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:24.832463 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:24.832772 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:24.833192 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:24.969375 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:24.977534 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-c31832fc-38a1-4df3-8fc1-cbbc379233e8 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1574 microversion: 2.1 time: 0.159275 Sep 08 16:18:24.978112 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 542/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:24 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 16:18:26.001865 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:26.002568 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:26.009440 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:26.009900 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:26.010333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:26.011036 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:26.011525 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:26.011954 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:26.188902 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:26.197268 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-246004d9-619a-4573-b456-ec792053d69a tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1574 microversion: 2.1 time: 0.199813 Sep 08 16:18:26.197840 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 584/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:25 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1574 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:26.775269 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-5f531021-bda2-43c2-8787-fe9f79e1e3fb req-1ea498b0-54b3-4ce2-8385-f9cb4233cc69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86f2f9b4-bf6c-45b3-b927-41d825203a5d", "name": "network-vif-deleted", "tag": "83311939-ae7e-4703-90a1-f4c265746217"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:26.785809 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-5f531021-bda2-43c2-8787-fe9f79e1e3fb req-1ea498b0-54b3-4ce2-8385-f9cb4233cc69 service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:26.786316 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-5f531021-bda2-43c2-8787-fe9f79e1e3fb req-1ea498b0-54b3-4ce2-8385-f9cb4233cc69 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:26.786683 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-5f531021-bda2-43c2-8787-fe9f79e1e3fb req-1ea498b0-54b3-4ce2-8385-f9cb4233cc69 service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:26.798379 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-5f531021-bda2-43c2-8787-fe9f79e1e3fb req-1ea498b0-54b3-4ce2-8385-f9cb4233cc69 service nova] Creating event network-vif-deleted:83311939-ae7e-4703-90a1-f4c265746217 for instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d on hv-cinder-85625 Sep 08 16:18:26.803629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-5f531021-bda2-43c2-8787-fe9f79e1e3fb req-1ea498b0-54b3-4ce2-8385-f9cb4233cc69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 Sep 08 16:18:26.804217 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 543/1127] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:27.220803 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:27.221446 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:27.228459 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:27.228940 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:27.229366 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:27.230055 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:27.230496 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:27.230942 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:27.265085 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:27.265441 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:27.265883 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:27.266322 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lazy-loading 'fault' on Instance uuid 86f2f9b4-bf6c-45b3-b927-41d825203a5d {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:18:27.308901 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77aeaed3d55945e49b0eb6e3c0519294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53275b4dc845465d8b0bfb50eacd14f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:18:27.317032 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d8c0fc20-6922-49a5-8af3-d06cb9cde8db tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 200 len: 1230 microversion: 2.1 time: 0.100267 Sep 08 16:18:27.317598 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 585/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:27 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:18:28.345666 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:28.346315 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 86f2f9b4-bf6c-45b3-b927-41d825203a5d] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:28.356238 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:28.356856 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:28.357422 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:28.358424 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:28.358990 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:28.359533 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:28.373797 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] HTTP exception thrown: Instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d could not be found. Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Request method failure captured: Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d HTTP/1.1 Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhPri3mzaSAG2ls7Qc10A2LBHxJWjfwV7Qg8n0GafcSQ_iEieNdBgLw9h29VkM29jCSKaXsUUONNnPH7XsoUwPFeweItJJQZqr0XkQQo1fi5WlJvrSkGeZDC68kMiQD_SMxaJeCJyzJzTDFvDVLhfCkAdkpoXwWf6acxGtUdZpSaaEw Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:18:28.375408 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53275b4dc845465d8b0bfb50eacd14f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}] Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 77aeaed3d55945e49b0eb6e3c0519294 Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d could not be found. Sep 08 16:18:28.377011 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '86f2f9b4-bf6c-45b3-b927-41d825203a5d'} Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d could not be found. Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:18:28.377884 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d could not be found. Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d could not be found. Sep 08 16:18:28.379669 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:28.381232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Returning 404 to user: Instance 86f2f9b4-bf6c-45b3-b927-41d825203a5d could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:18:28.381232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-21967fe3-775d-46dd-8c0a-7e57b888bae7 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d" status: 404 len: 111 microversion: 2.1 time: 0.038907 Sep 08 16:18:28.381232 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 544/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:28 2022] GET /compute/v2.1/servers/86f2f9b4-bf6c-45b3-b927-41d825203a5d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:18:29.091798 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:29.092394 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:29.098853 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:29.099333 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:29.099817 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:29.100484 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:29.100933 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:29.101348 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:29.114756 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.wsgi [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] HTTP exception thrown: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Request method failure captured: Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: request: DELETE /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c HTTP/1.1 Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept: application/json Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Accept-Encoding: identity Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Connection: close Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Length: 0 Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Content-Type: application/json Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Host: 10.222.0.27 Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: Openstack-System-Scope: None Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: User-Agent: python-urllib3/1.26.12 Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Auth-Token: gAAAAABjGhPri3mzaSAG2ls7Qc10A2LBHxJWjfwV7Qg8n0GafcSQ_iEieNdBgLw9h29VkM29jCSKaXsUUONNnPH7XsoUwPFeweItJJQZqr0XkQQo1fi5WlJvrSkGeZDC68kMiQD_SMxaJeCJyzJzTDFvDVLhfCkAdkpoXwWf6acxGtUdZpSaaEw Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Id: None Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Domain-Name: None Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Identity-Status: Confirmed Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Is-Admin-Project: True Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Id: default Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Domain-Name: Default Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Project-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Role: reader,member Sep 08 16:18:29.116451 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Roles: reader,member Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53275b4dc845465d8b0bfb50eacd14f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}] Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-Tenant-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Id: default Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Domain-Name: Default Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Id: 77aeaed3d55945e49b0eb6e3c0519294 Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: X-User-Name: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: method: > Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: exception: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.118149 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: action_args: {'id': '08dfe24f-aaf4-47c1-8f58-017da860325c'} Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:18:29.119108 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.120734 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.122297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Returning 404 to user: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. {{(pid=120783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:18:29.122297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-38ec50b9-6aa3-49c2-8677-f7bd6a01ded5 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 404 len: 111 microversion: 2.1 time: 0.030049 Sep 08 16:18:29.122297 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 586/1130] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:18:29 2022] DELETE /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:18:29.126840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:29.127478 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] [instance: 08dfe24f-aaf4-47c1-8f58-017da860325c] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:29.133528 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:29.134012 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:29.134452 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:29.135151 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:29.135629 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:29.136032 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:29.149757 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] HTTP exception thrown: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Request method failure captured: Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c HTTP/1.1 Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhPri3mzaSAG2ls7Qc10A2LBHxJWjfwV7Qg8n0GafcSQ_iEieNdBgLw9h29VkM29jCSKaXsUUONNnPH7XsoUwPFeweItJJQZqr0XkQQo1fi5WlJvrSkGeZDC68kMiQD_SMxaJeCJyzJzTDFvDVLhfCkAdkpoXwWf6acxGtUdZpSaaEw Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:18:29.151295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53275b4dc845465d8b0bfb50eacd14f6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53275b4dc845465d8b0bfb50eacd14f6"}]}] Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 53275b4dc845465d8b0bfb50eacd14f6 Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestVolumeBootPattern-959899855 Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: 77aeaed3d55945e49b0eb6e3c0519294 Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestVolumeBootPattern-959899855-project Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.153033 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': '08dfe24f-aaf4-47c1-8f58-017da860325c'} Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:18:29.154003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. Sep 08 16:18:29.155623 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:29.157180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Returning 404 to user: Instance 08dfe24f-aaf4-47c1-8f58-017da860325c could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:18:29.157180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-6289ea2a-dcea-43e4-ae9f-4a0e2602fc0b tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c" status: 404 len: 111 microversion: 2.1 time: 0.029817 Sep 08 16:18:29.157180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 545/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:18:29 2022] GET /compute/v2.1/servers/08dfe24f-aaf4-47c1-8f58-017da860325c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 16:18:30.464227 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-ef880fb7-fbb3-4ed5-b3d6-a868ff23f590 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] Calling method '.version_select at 0x7f88603690d0>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:30.490826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-ef880fb7-fbb3-4ed5-b3d6-a868ff23f590 tempest-TestVolumeBootPattern-959899855 tempest-TestVolumeBootPattern-959899855-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1361964657" status: 202 len: 0 microversion: 2.1 time: 0.030501 Sep 08 16:18:30.491420 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 587/1132] 10.222.0.27 () {58 vars in 1263 bytes} [Thu Sep 8 16:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1361964657 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:56.007918 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-297363799"}} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:56.009108 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:56.011934 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:56.012585 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG dbcounter [-] [120782] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120782) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:56.018562 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:56.019042 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:56.019477 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:56.020199 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:56.020665 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:56.021346 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:56.161294 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.network.security_group_api [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Removing security group 37183367-5e30-47be-a058-99ad6a839222 from port a912bb4d-d25e-4e9b-bbea-23a34ace75b7 Sep 08 16:18:56.472008 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-ca295fd7-c272-4e16-be30-a06c3c952262 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action" status: 202 len: 0 microversion: 2.1 time: 0.467943 Sep 08 16:18:56.475749 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 546/1133] 10.222.0.27 () {60 vars in 1278 bytes} [Thu Sep 8 16:18:56 2022] POST /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:56.503661 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:56.505604 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG dbcounter [-] [120783] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 16:18:56.719826 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [req-65d2a5f8-df5d-4e31-855d-2008ec592db0 req-590e07f0-34c7-46fe-8fc9-e4d2357101bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:56.735291 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-65d2a5f8-df5d-4e31-855d-2008ec592db0 req-590e07f0-34c7-46fe-8fc9-e4d2357101bc service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:56.736692 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-65d2a5f8-df5d-4e31-855d-2008ec592db0 req-590e07f0-34c7-46fe-8fc9-e4d2357101bc service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:56.737492 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [req-65d2a5f8-df5d-4e31-855d-2008ec592db0 req-590e07f0-34c7-46fe-8fc9-e4d2357101bc service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:56.750249 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.compute.server_external_events [req-65d2a5f8-df5d-4e31-855d-2008ec592db0 req-590e07f0-34c7-46fe-8fc9-e4d2357101bc service nova] Creating event network-changed:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:18:56.756308 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [req-65d2a5f8-df5d-4e31-855d-2008ec592db0 req-590e07f0-34c7-46fe-8fc9-e4d2357101bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257524 Sep 08 16:18:56.757132 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 588/1134] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:58.192583 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:58.193145 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:58.199999 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:58.200496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:58.200933 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:58.201627 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:58.202082 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:58.202507 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:58.286579 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.objects.instance [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lazy-loading 'services' on Instance uuid d39c6063-d010-45c5-b4e4-f1853f44b035 {{(pid=120782) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:18:58.358740 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-482a8e1c-aa40-4cb0-b945-8f169a744af1 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments/df27cd3b-b240-419e-8a3f-892782a9349d" status: 202 len: 0 microversion: 2.1 time: 0.170483 Sep 08 16:18:58.359496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 547/1135] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:18:58 2022] DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments/df27cd3b-b240-419e-8a3f-892782a9349d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 16:18:58.369023 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:58.371258 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:58.377587 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:58.378105 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:58.378542 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:58.379369 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:58.379874 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:58.380270 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:58.411379 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-eb774c5a-fc9b-4fe6-840c-1ee27235b13b tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047325 Sep 08 16:18:58.412080 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 589/1136] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:18:58 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:58.799886 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-6ce032f0-8fcc-4e48-8e7f-e84156daaffe req-d9f56b07-87ae-4ebd-abdc-a8347c80674b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:18:58.810404 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6ce032f0-8fcc-4e48-8e7f-e84156daaffe req-d9f56b07-87ae-4ebd-abdc-a8347c80674b service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:58.810873 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6ce032f0-8fcc-4e48-8e7f-e84156daaffe req-d9f56b07-87ae-4ebd-abdc-a8347c80674b service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:58.811293 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-6ce032f0-8fcc-4e48-8e7f-e84156daaffe req-d9f56b07-87ae-4ebd-abdc-a8347c80674b service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:58.824840 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-6ce032f0-8fcc-4e48-8e7f-e84156daaffe req-d9f56b07-87ae-4ebd-abdc-a8347c80674b service nova] Creating event network-changed:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:18:58.830180 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-6ce032f0-8fcc-4e48-8e7f-e84156daaffe req-d9f56b07-87ae-4ebd-abdc-a8347c80674b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034311 Sep 08 16:18:58.831295 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 548/1137] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:18:59.428689 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:59.431824 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:59.438603 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:59.439087 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:59.439538 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:59.440226 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:59.440666 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:59.441086 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:59.470399 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-336a1cdc-4340-4d9a-ab3f-337b2b4f0359 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048501 Sep 08 16:18:59.470856 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 590/1138] 10.222.0.27 () {58 vars in 1302 bytes} [Thu Sep 8 16:18:59 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 16:18:59.488428 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:18:59.489048 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:18:59.496833 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:59.497320 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:59.497755 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:59.498480 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:18:59.498935 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:18:59.499358 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:18:59.584025 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] HTTP exception thrown: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 is not attached to volume df27cd3b-b240-419e-8a3f-892782a9349d Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Request method failure captured: Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments/df27cd3b-b240-419e-8a3f-892782a9349d HTTP/1.1 Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhVpau3DAY_JWcMSyFegJ50p28TvPXqkD0eR6jdBmaUiRlgt1UCp-ZquEYzoZ0Zeg4mTySMzgxYmicCvJ3HPe24uifsi7r8lYRXsX1WqsGbCFd4TOPvSlJY9OuBZEFPzj_93qRc7Puqyg2245HvtPLkWeQqiUfJ2ksAPZAgMa17c_Fo Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 223d0d2bc7a54f5b9ccc4b4414604d87 Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestMinimumBasicScenario-1003964293 Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:18:59.593674 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/223d0d2bc7a54f5b9ccc4b4414604d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_223d0d2bc7a54f5b9ccc4b4414604d87", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/223d0d2bc7a54f5b9ccc4b4414604d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/223d0d2bc7a54f5b9ccc4b4414604d87"}]}] Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestMinimumBasicScenario-1003964293 Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 223d0d2bc7a54f5b9ccc4b4414604d87 Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1003964293 Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestMinimumBasicScenario-1003964293-project Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: d87960cdc11f47e2ac431484d3a56bd2 Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestMinimumBasicScenario-1003964293-project Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:18:59.595425 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 is not attached to volume df27cd3b-b240-419e-8a3f-892782a9349d Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'server_id': 'd39c6063-d010-45c5-b4e4-f1853f44b035', 'id': 'df27cd3b-b240-419e-8a3f-892782a9349d'} Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id df27cd3b-b240-419e-8a3f-892782a9349d. Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:18:59.596496 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 is not attached to volume df27cd3b-b240-419e-8a3f-892782a9349d Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 is not attached to volume df27cd3b-b240-419e-8a3f-892782a9349d Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:18:59.598160 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Returning 404 to user: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 is not attached to volume df27cd3b-b240-419e-8a3f-892782a9349d {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:18:59.599592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8156170d-6eb7-4ed6-a69e-def0e5c2f02d tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments/df27cd3b-b240-419e-8a3f-892782a9349d" status: 404 len: 154 microversion: 2.1 time: 0.113601 Sep 08 16:18:59.599592 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 549/1139] 10.222.0.27 () {58 vars in 1416 bytes} [Thu Sep 8 16:18:59 2022] DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035/os-volume_attachments/df27cd3b-b240-419e-8a3f-892782a9349d => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:19:00.754735 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:00.755306 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:19:00.762352 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:00.762829 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:00.763275 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:00.764027 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:00.764473 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:00.764890 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:00.790088 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Going to try to terminate instance {{(pid=120783) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 16:19:00.868264 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-62b8848d-91b8-4712-ac77-b919ee990b64 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 204 len: 0 microversion: 2.1 time: 0.117684 Sep 08 16:19:00.868855 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 591/1140] 10.222.0.27 () {58 vars in 1239 bytes} [Thu Sep 8 16:19:00 2022] DELETE /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 16:19:00.877930 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:00.878916 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:19:00.885563 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:00.886058 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:00.887386 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:00.888122 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:00.888577 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:00.889003 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:01.020849 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.policy [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120782) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:01.029148 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-8f370a85-d57a-40e7-8b77-84460def9825 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1553 microversion: 2.1 time: 0.155736 Sep 08 16:19:01.029724 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 550/1141] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:19:00 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:02.057315 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:02.058455 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:19:02.069247 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:02.070042 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:02.070755 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:02.072134 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:02.072839 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:02.074562 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:02.227515 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:02.236078 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-59802b86-eb7f-4cff-a3e4-edacb00e4594 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1553 microversion: 2.1 time: 0.186296 Sep 08 16:19:02.236645 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 592/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:19:02 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:03.036626 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [req-0fedd416-5b5c-4195-b50e-6f27c313d16b req-72b3d796-ec2d-4323-a19e-0e73563b972c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39c6063-d010-45c5-b4e4-f1853f44b035", "name": "network-vif-deleted", "tag": "a912bb4d-d25e-4e9b-bbea-23a34ace75b7"}]} {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 16:19:03.047334 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0fedd416-5b5c-4195-b50e-6f27c313d16b req-72b3d796-ec2d-4323-a19e-0e73563b972c service nova] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:03.047847 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0fedd416-5b5c-4195-b50e-6f27c313d16b req-72b3d796-ec2d-4323-a19e-0e73563b972c service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:03.048278 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [req-0fedd416-5b5c-4195-b50e-6f27c313d16b req-72b3d796-ec2d-4323-a19e-0e73563b972c service nova] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:03.060376 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.compute.server_external_events [req-0fedd416-5b5c-4195-b50e-6f27c313d16b req-72b3d796-ec2d-4323-a19e-0e73563b972c service nova] Creating event network-vif-deleted:a912bb4d-d25e-4e9b-bbea-23a34ace75b7 for instance d39c6063-d010-45c5-b4e4-f1853f44b035 on hv-cinder-85625 Sep 08 16:19:03.065461 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [req-0fedd416-5b5c-4195-b50e-6f27c313d16b req-72b3d796-ec2d-4323-a19e-0e73563b972c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Sep 08 16:19:03.066092 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 551/1143] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Sep 8 16:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 16:19:03.264464 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:03.265220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.compute.api [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120783) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:19:03.275477 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:03.275973 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:03.276427 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:03.277066 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:03.277530 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:03.277947 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:03.309014 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:03.309564 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:03.309905 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG oslo_concurrency.lockutils [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:03.310363 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.objects.instance [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lazy-loading 'fault' on Instance uuid d39c6063-d010-45c5-b4e4-f1853f44b035 {{(pid=120783) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 16:19:03.351857 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.policy [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87960cdc11f47e2ac431484d3a56bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '223d0d2bc7a54f5b9ccc4b4414604d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120783) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 16:19:03.360065 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-19935d15-bfe4-4ad5-9bbb-c0933210fa46 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 200 len: 1348 microversion: 2.1 time: 0.101746 Sep 08 16:19:03.360675 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 593/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:19:03 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 16:19:04.389177 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '>' {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:04.390331 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.compute.api [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] [instance: d39c6063-d010-45c5-b4e4-f1853f44b035] Fetching instance by UUID {{(pid=120782) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 16:19:04.400817 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:04.401611 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:04.402338 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:04.403522 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Acquiring lock "8767b60e-3134-411b-81c6-9212f447c551" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 16:19:04.404267 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 16:19:04.404965 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG oslo_concurrency.lockutils [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Lock "8767b60e-3134-411b-81c6-9212f447c551" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 16:19:04.423142 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.wsgi [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] HTTP exception thrown: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 could not be found. Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Request method failure captured: Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: request: GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 HTTP/1.1 Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept: application/json Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Accept-Encoding: identity Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Connection: close Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Length: 0 Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Content-Type: application/json Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Host: 10.222.0.27 Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: Openstack-System-Scope: None Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: User-Agent: python-urllib3/1.26.12 Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Auth-Token: gAAAAABjGhVpau3DAY_JWcMSyFegJ50p28TvPXqkD0eR6jdBmaUiRlgt1UCp-ZquEYzoZ0Zeg4mTySMzgxYmicCvJ3HPe24uifsi7r8lYRXsX1WqsGbCFd4TOPvSlJY9OuBZEFPzj_93qRc7Puqyg2245HvtPLkWeQqiUfJ2ksAPZAgMa17c_Fo Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Id: None Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Domain-Name: None Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Identity-Status: Confirmed Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Is-Admin-Project: True Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Id: default Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Domain-Name: Default Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Id: 223d0d2bc7a54f5b9ccc4b4414604d87 Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Project-Name: tempest-TestMinimumBasicScenario-1003964293 Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Role: reader,member Sep 08 16:19:04.424791 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Roles: reader,member Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/223d0d2bc7a54f5b9ccc4b4414604d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_223d0d2bc7a54f5b9ccc4b4414604d87", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/223d0d2bc7a54f5b9ccc4b4414604d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/223d0d2bc7a54f5b9ccc4b4414604d87"}]}] Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant: tempest-TestMinimumBasicScenario-1003964293 Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Id: 223d0d2bc7a54f5b9ccc4b4414604d87 Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1003964293 Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User: tempest-TestMinimumBasicScenario-1003964293-project Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Id: default Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Domain-Name: Default Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Id: d87960cdc11f47e2ac431484d3a56bd2 Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: X-User-Name: tempest-TestMinimumBasicScenario-1003964293-project Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: method: > Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: exception: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 could not be found. Sep 08 16:19:04.426539 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: action_args: {'id': 'd39c6063-d010-45c5-b4e4-f1853f44b035'} Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: {{(pid=120782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 could not be found. Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 16:19:04.427618 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 could not be found. Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 could not be found. Sep 08 16:19:04.429276 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: ERROR nova.api.openstack.wsgi Sep 08 16:19:04.431166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: DEBUG nova.api.openstack.wsgi [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Returning 404 to user: Instance d39c6063-d010-45c5-b4e4-f1853f44b035 could not be found. {{(pid=120782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 16:19:04.431166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: INFO nova.api.openstack.requestlog [None req-d50d0979-dfd6-4098-acf2-e22eced81ae2 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035" status: 404 len: 111 microversion: 2.1 time: 0.045001 Sep 08 16:19:04.431166 dv-cinder-856259-2-iscsi devstack@n-api.service[120782]: [pid: 120782|app: 0|req: 552/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Thu Sep 8 16:19:04 2022] GET /compute/v2.1/servers/d39c6063-d010-45c5-b4e4-f1853f44b035 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 16:19:04.435476 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: DEBUG nova.api.openstack.wsgi [None req-d8cf3c25-55fb-4536-984a-b19732bdd6f8 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] Calling method '.version_select at 0x7f8860d68670>' {{(pid=120783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 16:19:04.456751 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: INFO nova.api.openstack.requestlog [None req-d8cf3c25-55fb-4536-984a-b19732bdd6f8 tempest-TestMinimumBasicScenario-1003964293 tempest-TestMinimumBasicScenario-1003964293-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508642010" status: 202 len: 0 microversion: 2.1 time: 0.025024 Sep 08 16:19:04.457220 dv-cinder-856259-2-iscsi devstack@n-api.service[120783]: [pid: 120783|app: 0|req: 594/1146] 10.222.0.27 () {58 vars in 1269 bytes} [Thu Sep 8 16:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-508642010 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)